-- Logs begin at Thu 2022-10-06 11:41:27 UTC, end at Thu 2022-10-06 12:42:51 UTC. -- Oct 06 12:07:04.891075 dv-cinder-856041-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 06 12:07:04.903265 dv-cinder-856041-2-smb devstack@keystone.service[81436]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 12:07:04 2022] *** Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: nodename: dv-cinder-856041-2-smb Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: machine: x86_64 Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: clock source: unix Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: pcre jit disabled Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: detected number of CPU cores: 4 Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: current working directory: / Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: detected binary path: /usr/bin/uwsgi-core Oct 06 12:07:04.905345 dv-cinder-856041-2-smb devstack@keystone.service[81436]: your processes number limit is 47680 Oct 06 12:07:04.905967 dv-cinder-856041-2-smb devstack@keystone.service[81436]: your memory page size is 4096 bytes Oct 06 12:07:04.905967 dv-cinder-856041-2-smb devstack@keystone.service[81436]: detected max file descriptor number: 2048 Oct 06 12:07:04.905967 dv-cinder-856041-2-smb devstack@keystone.service[81436]: lock engine: pthread robust mutexes Oct 06 12:07:04.905967 dv-cinder-856041-2-smb devstack@keystone.service[81436]: thunder lock: enabled Oct 06 12:07:04.905967 dv-cinder-856041-2-smb devstack@keystone.service[81436]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 06 12:07:04.905967 dv-cinder-856041-2-smb devstack@keystone.service[81436]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 12:07:04.945935 dv-cinder-856041-2-smb devstack@keystone.service[81436]: Python main interpreter initialized at 0x55916c0a99c0 Oct 06 12:07:04.945935 dv-cinder-856041-2-smb devstack@keystone.service[81436]: python threads support enabled Oct 06 12:07:04.945935 dv-cinder-856041-2-smb devstack@keystone.service[81436]: your server socket listen backlog is limited to 100 connections Oct 06 12:07:04.945935 dv-cinder-856041-2-smb devstack@keystone.service[81436]: your mercy for graceful operations on workers is 90 seconds Oct 06 12:07:04.946712 dv-cinder-856041-2-smb devstack@keystone.service[81436]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 12:07:04.946712 dv-cinder-856041-2-smb devstack@keystone.service[81436]: *** Operational MODE: preforking *** Oct 06 12:07:04.946712 dv-cinder-856041-2-smb devstack@keystone.service[81436]: *** uWSGI is running in multiple interpreter mode *** Oct 06 12:07:04.946712 dv-cinder-856041-2-smb devstack@keystone.service[81436]: spawned uWSGI master process (pid: 81436) Oct 06 12:07:04.948944 dv-cinder-856041-2-smb devstack@keystone.service[81436]: spawned uWSGI worker 1 (pid: 81448, cores: 1) Oct 06 12:07:04.948944 dv-cinder-856041-2-smb devstack@keystone.service[81436]: spawned uWSGI worker 2 (pid: 81449, cores: 1) Oct 06 12:07:04.948944 dv-cinder-856041-2-smb devstack@keystone.service[81436]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 12:07:04.946923 dv-cinder-856041-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 06 12:07:09.291689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:07:09.291689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Oct 06 12:07:09.292481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:07:09.292481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Oct 06 12:07:09.292594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:07:09.292594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: from cryptography.utils import int_from_bytes Oct 06 12:07:09.293009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 12:07:09.293009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: from cryptography.utils import int_from_bytes Oct 06 12:07:09.342048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:07:09.342230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 12:07:09.342324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:07:09.342410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 12:07:09.342478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] command line args: [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:07:09.342542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] command line args: [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 12:07:09.342681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:07:09.342805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 12:07:09.342893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ================================================================================ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:07:09.342974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ================================================================================ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 12:07:09.343101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.343220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] admin_token = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.343352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_dir = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.343463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] config_dir = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.343548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.343654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.343741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_source = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.343834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] config_source = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.343917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] debug = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] debug = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.344934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_config_append = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_config_append = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345796 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_dir = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_dir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.345994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_file = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.346057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.346313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.346402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.346473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.346539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.346702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.346831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.346952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.347077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.347206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.347319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.347434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.347549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.347671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.347798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.347914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.348982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.349109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.349239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.349396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.349518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.349656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.349781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.350472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.350712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.351242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] publish_errors = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.351370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] publish_errors = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.351486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.351486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.351704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.351820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.351933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.351933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.352155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.352155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.352385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.352509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] standard_threads = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.352630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.352745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.352859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] standard_threads = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.352972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.353084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.353262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.353380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.353499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_journal = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.353632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.353747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_json = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.353861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_journal = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.353994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_stderr = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.354109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_json = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.354230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] use_syslog = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.354350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_stderr = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.354464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.354620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_syslog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.354746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.354866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 12:07:09.354981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.355093 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.355205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.355324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.355446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.355560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.355672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.355790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.355909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356597 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.356944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.357057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.357159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.357278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.357392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.357516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.357953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.358080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.358209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.358331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.358451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.358578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.358785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.358902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359131 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.359986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.360970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.361084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.361198 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.361322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.361437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.361604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.361734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.361855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.361970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.362091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.362211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.362327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.362440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.362560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.362674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.362795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.362910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.363952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.364066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.364188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.364308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.364424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.364543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.364676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.364792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.364981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.365105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.365218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.365332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.365446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.366829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.366971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.367089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.367204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.367318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.367439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.367556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.367678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.367793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.367907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.368956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.369079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.369194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.369307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.369427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.369594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.369748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.369859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.369957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.370959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.371084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.371208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.371336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.371452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.371575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.371705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.371823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.371943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.372049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.372206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.372325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.372439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.372561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.372676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.372789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.372903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373468 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.373954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.374069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.374191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.374308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.374423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.374536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.374657 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.374771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.374894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.375938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.376977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.377092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.377207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.377321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.377434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.377599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.377825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.377971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.378089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.378211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.378328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.378444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.378566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.378690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.378817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.378933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.379090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.379215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.379331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.379452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.379579 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.379696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.379811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.379926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.380041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.380163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.380315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.380440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.380556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.380682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.380799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.380922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.381038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.381310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.381920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.382040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.382169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.382296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.382411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.382525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.382670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.external = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.382799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.382916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.external = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.password = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.token = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.383971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.password = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] auth.token = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.384906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.385120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.385235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.385359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.385359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.385591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.385591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.385807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.385922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.386996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.387111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.387226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.387346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.387471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.387588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.387703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.387818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.387932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388640 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.388994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.389109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.389223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.389336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.389457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.389605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.389724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.389839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.389954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.390069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.390184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.390306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.390423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.390538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.390654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.390769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.390884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391127 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.391940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.392054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.392169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.392365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.392484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.392599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.392715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.392830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.392945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.393068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.393193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.393313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.393435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.393584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.393706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.393834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.393951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.394066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.394180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.394295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.394295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.394563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.394718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.394853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.394969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.395085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.395200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.395325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.395454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.395571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.395693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.395811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.395926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.396050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.396167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.396282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.396398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.396513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.396640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.396801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.397419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.397573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.397695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.397811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.397929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.398059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.398178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.398299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.398416 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.398532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.398648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.398771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.398888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.399005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.399122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.399237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.399354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.399478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.399478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.399697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.399697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.400174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.400301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.400426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.400544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.400659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.400775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.400891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.401972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.402088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.402203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.402318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.402432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.402558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.402674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.402789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.402903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.403939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404409 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404532 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.404991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.405971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.406188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.406188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.406411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.406411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.406634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.406750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.406868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.406983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.407098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.407212 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.407335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.407451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.407566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.407680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.407794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.407909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.408958 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.409072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.409186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.409301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.409413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.409529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.409660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.409775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.409889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.410944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.411984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.412098 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.412221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.412337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.413078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.413518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.413694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.413812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.413942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.414984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.415188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.415312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.415429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.415429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.415645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.415761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.415876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.416000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.416117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.416232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.416347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.416463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.416578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.416770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.416890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] role.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] role.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.417970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.418602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.418725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.418842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.418959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.419081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.419197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.419313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.419437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.419553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.419669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.419784 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.419899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.421071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.421186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.421301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.421416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.421557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.421677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.421793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.421907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.422964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.423082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.423198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.423312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.423427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.423551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.423667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.423783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.423898 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.424954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.425071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.425187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.425303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.425418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.425595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.425727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.425727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.425945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.426863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.427086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.427202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.427321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.427438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.427552 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.427668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.427790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.427907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.428637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.429150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.429284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.429412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.429530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.429662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.429852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.430234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.430354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.430472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.430587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.430703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.430828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.430946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.431061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.431177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.431292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.431416 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.431534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.431650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.431765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.431895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.432957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.433081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.433198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.433314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.433429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.433593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.433713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.433842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.433960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.434766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.435693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 12:07:09.435693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 12:07:09.460211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.460363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.460438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.460570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.460740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.460824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.469050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.469153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.498175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.498348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.498437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.498554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.550584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.551898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.599975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.600134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.600213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.600276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.666871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.667055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.667220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.667445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.667673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.667889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.749999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.750236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.750442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.750666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.750946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.751171 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.767461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.767694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.767923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.768148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.768369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.768589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.768809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.781472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.784967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.784967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.785199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.785423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.785668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.785884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.786095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.794192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.794504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.794743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.794975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.795203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.795426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.795647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.795867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.796978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.797209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.797434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.797680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.797895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.798104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.798315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81448) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 06 12:07:09.813063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.813271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 12:07:09.813372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.813486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 12:07:09.813644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.813849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 12:07:09.813930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.814044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 06 12:07:09.814139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.814319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.814402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.814583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.814663 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.814840 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.814923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.815096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.824601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.824696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.824878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.824972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.825147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.825230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.825425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.825508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.832370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.832457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.835785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.835924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.836064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.836213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.836347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.836497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.836628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.836781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.836907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.837065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.837165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.837327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.837431 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.837629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.837727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.837907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.838107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.838189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.838383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.838472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.838655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.838737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.860859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.861174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.862358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.862636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.862720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.862956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.867931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.868141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.868241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.868427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.868510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.868761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.874770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.875024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.875119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.875458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.879105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.879395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.879678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.879960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.880234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.880509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.880780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.880953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.881043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.881302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.881620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.881930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.882189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.882477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.882753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.883025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.897069 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.897343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.898933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.899251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.902138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.903403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.905302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.905632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.906647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.906949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.909804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.911145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.913124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.914353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.916427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.916727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.917053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.917306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.917565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.917649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.917880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.917962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.918280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.918493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.918783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.919085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.935162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.935438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.935550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.935710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.935798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.935977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.936072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.936246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.942850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.943113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.944664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.944833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.946227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.946382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.946517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.946655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.949209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.949293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.949499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.949621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.949814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.949907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.950112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.950209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.950458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.950552 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.962141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.962250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.962428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.962515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.962719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.962850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.963004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.963133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.963386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.963470 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.963668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.963750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.963960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.964060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.979272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.979378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.982168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.982299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.985025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.985180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.986461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.986716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.988051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.988306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.988426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.988590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.988674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.988990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.995548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.995862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:09.996996 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.997321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:09.999983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.000220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.000319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.000539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.000621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.000813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.000897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.001153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.008580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:10.008864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.009011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:10.009144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.009328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.009641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.015973 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81448) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:10.016254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.016519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 06 12:07:10.016603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.016804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.016888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.017085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.017169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.017356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.017440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.017650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.017736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.017923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.018016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.018194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.018278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.018474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.018555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.018745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.018836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.019006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.019087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.019274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.019356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.019561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.019692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81448) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.019826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.020093 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 06 12:07:10.054038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55916c0a99c0 pid: 81448 (default app) Oct 06 12:07:10.055555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55916c0a99c0 pid: 81449 (default app) Oct 06 12:07:10.057414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f5b6-97a0-430c-95de-b8a17d328001 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:10.057726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f5b6-97a0-430c-95de-b8a17d328001 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:10.057999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f5b6-97a0-430c-95de-b8a17d328001 None None] PATH_INFO: `/v3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:10.062143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Oct 6 12:07:10 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:16.942614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23affa2-5fe0-4210-a540-f4ec57ae7104 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:16.943232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23affa2-5fe0-4210-a540-f4ec57ae7104 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:16.943232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23affa2-5fe0-4210-a540-f4ec57ae7104 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:16.948199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:16.953932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:16.954493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:16.954493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:17.025551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: INFO dbcounter [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] Registered counter for database keystone Oct 06 12:07:17.044841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG oslo_db.sqlalchemy.engines [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:07:17.050947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writer thread running {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:07:17.250709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG passlib.handlers.bcrypt [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81448) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 06 12:07:17.250960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG passlib.handlers.bcrypt [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81448) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 06 12:07:17.311986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:17.313622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:17.448331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 06 12:07:17.734337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23affa2-5fe0-4210-a540-f4ec57ae7104 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:17.804587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: INFO dbcounter [None req-d23affa2-5fe0-4210-a540-f4ec57ae7104 None None] Registered counter for database keystone Oct 06 12:07:17.826620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG oslo_db.sqlalchemy.engines [None req-d23affa2-5fe0-4210-a540-f4ec57ae7104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 12:07:17.832824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writer thread running {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 12:07:17.952442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23affa2-5fe0-4210-a540-f4ec57ae7104 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:17.957044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111aca96-6b57-4bf0-bc84-688748e9cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:17.957757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aca96-6b57-4bf0-bc84-688748e9cf69 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:17.958076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aca96-6b57-4bf0-bc84-688748e9cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:17.958387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aca96-6b57-4bf0-bc84-688748e9cf69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:17.967437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aca96-6b57-4bf0-bc84-688748e9cf69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:18.019353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WARNING keystone.common.rbac_enforcer.enforcer [None req-111aca96-6b57-4bf0-bc84-688748e9cf69 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 06 12:07:18.019636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aca96-6b57-4bf0-bc84-688748e9cf69 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:18.031294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Oct 6 12:07:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:07:18.037987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:18.055674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394a2c-a590-4ec0-9691-780662b456b5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:18.060295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a01b7-7957-4b62-a3a7-ffc1afad74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:18.061411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a01b7-7957-4b62-a3a7-ffc1afad74d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:18.061719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a01b7-7957-4b62-a3a7-ffc1afad74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:18.061995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a01b7-7957-4b62-a3a7-ffc1afad74d5 admin admin] PATH_INFO: `/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:18.063588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a01b7-7957-4b62-a3a7-ffc1afad74d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=9d4ef6c76dd94ad5804c0357e8bec7fc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:18.115504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a37a01b7-7957-4b62-a3a7-ffc1afad74d5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 06 12:07:18.116423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a01b7-7957-4b62-a3a7-ffc1afad74d5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:18.121105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Oct 6 12:07:18 2022] GET /identity/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:20.277703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f35bf-a7bf-4e35-97ca-0d72761b7c4b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:20.278277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f35bf-a7bf-4e35-97ca-0d72761b7c4b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:20.278277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f35bf-a7bf-4e35-97ca-0d72761b7c4b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:20.282499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:20.288854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b579ef-e75b-48cd-b48e-138d0deaf4c6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:20.289569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b579ef-e75b-48cd-b48e-138d0deaf4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:20.289569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b579ef-e75b-48cd-b48e-138d0deaf4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:20.310462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-96b579ef-e75b-48cd-b48e-138d0deaf4c6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:20.312061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-96b579ef-e75b-48cd-b48e-138d0deaf4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:20.320901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 06 12:07:20.600592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f35bf-a7bf-4e35-97ca-0d72761b7c4b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:20.612996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f35bf-a7bf-4e35-97ca-0d72761b7c4b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:20.618234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab9f2b-89c4-4729-9a44-b64ebf369e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:20.618865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9f2b-89c4-4729-9a44-b64ebf369e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:20.619156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9f2b-89c4-4729-9a44-b64ebf369e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:20.619435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9f2b-89c4-4729-9a44-b64ebf369e7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:20.628204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab9f2b-89c4-4729-9a44-b64ebf369e7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:20.630047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab9f2b-89c4-4729-9a44-b64ebf369e7e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:20.640596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Oct 6 12:07:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:07:20.646608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b579ef-e75b-48cd-b48e-138d0deaf4c6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:20.656505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b579ef-e75b-48cd-b48e-138d0deaf4c6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:20.660943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd858d9a-8f68-486c-9f77-22efd0d717b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:20.661630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858d9a-8f68-486c-9f77-22efd0d717b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:20.661912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858d9a-8f68-486c-9f77-22efd0d717b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:20.662191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd858d9a-8f68-486c-9f77-22efd0d717b1 admin admin] PATH_INFO: `/v3/users/76a491a3cc6546888fbf514517cd658a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:20.663848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858d9a-8f68-486c-9f77-22efd0d717b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=76a491a3cc6546888fbf514517cd658a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:20.665740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd858d9a-8f68-486c-9f77-22efd0d717b1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:20.667348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Oct 6 12:07:20 2022] GET /identity/v3/users/76a491a3cc6546888fbf514517cd658a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:22.923031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d80f0-4aca-45a3-b6a0-8b7c1b242b55 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:22.923620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d80f0-4aca-45a3-b6a0-8b7c1b242b55 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:22.923620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d80f0-4aca-45a3-b6a0-8b7c1b242b55 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:22.924927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:22.931945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefc32-fd6e-4ec8-be09-107fa97e34b2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:22.932518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefc32-fd6e-4ec8-be09-107fa97e34b2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:22.932518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefc32-fd6e-4ec8-be09-107fa97e34b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:22.951687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-95cefc32-fd6e-4ec8-be09-107fa97e34b2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:22.952904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-95cefc32-fd6e-4ec8-be09-107fa97e34b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:23.039094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:23.058749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d8b5f-f8fe-4973-9a5d-c5e2ea4b4b80 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:23.059202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d8b5f-f8fe-4973-9a5d-c5e2ea4b4b80 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:23.059303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d8b5f-f8fe-4973-9a5d-c5e2ea4b4b80 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:23.060593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 6/12] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:23.066239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fb90b-6079-4fb9-9e85-d60f3184881a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:23.066521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fb90b-6079-4fb9-9e85-d60f3184881a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:23.066809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fb90b-6079-4fb9-9e85-d60f3184881a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:23.094027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e52fb90b-6079-4fb9-9e85-d60f3184881a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:23.095737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e52fb90b-6079-4fb9-9e85-d60f3184881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:23.113495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:23.177803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:23.311472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d8b5f-f8fe-4973-9a5d-c5e2ea4b4b80 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:23.449444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fb90b-6079-4fb9-9e85-d60f3184881a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:23.457492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d8b5f-f8fe-4973-9a5d-c5e2ea4b4b80 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:23.494062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06b7f8-e7df-448f-8831-ed24519956f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:23.494934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06b7f8-e7df-448f-8831-ed24519956f9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:23.495218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06b7f8-e7df-448f-8831-ed24519956f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:23.495496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06b7f8-e7df-448f-8831-ed24519956f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:23.508982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06b7f8-e7df-448f-8831-ed24519956f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7c06b7f8-e7df-448f-8831-ed24519956f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:23.517808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:23.518723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:23.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:07:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:23.525297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06b7f8-e7df-448f-8831-ed24519956f9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:23.556021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fb90b-6079-4fb9-9e85-d60f3184881a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:23.559987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:23.592762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a6b5e-0f3c-4b39-a7f1-cdde1a30e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:23.593386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6b5e-0f3c-4b39-a7f1-cdde1a30e6ca None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:23.593704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6b5e-0f3c-4b39-a7f1-cdde1a30e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:23.593980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6b5e-0f3c-4b39-a7f1-cdde1a30e6ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:23.617695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:23.631184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06b7f8-e7df-448f-8831-ed24519956f9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:23.667235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a6b5e-0f3c-4b39-a7f1-cdde1a30e6ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:23.668710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a6b5e-0f3c-4b39-a7f1-cdde1a30e6ca None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:23.670908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:23.671527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:23.671817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:23.672100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:23.672785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:23.673095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:23.674510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:23.686459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:23.692248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:23.766497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 12:07:23.772661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a6b5e-0f3c-4b39-a7f1-cdde1a30e6ca None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:23.789056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:23.798581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40ede4-fb09-4ece-8e0c-f9a354737835 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:23.831794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:23.835407 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ccc45-4893-4022-80e5-0b13cca93d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:23.836002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ccc45-4893-4022-80e5-0b13cca93d4f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:23.836284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ccc45-4893-4022-80e5-0b13cca93d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:23.836556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ccc45-4893-4022-80e5-0b13cca93d4f None admin] PATH_INFO: `/v3/users/76a491a3cc6546888fbf514517cd658a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:23.838158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ccc45-4893-4022-80e5-0b13cca93d4f None admin] RBAC: Authorizing `identity:get_user(user_id=76a491a3cc6546888fbf514517cd658a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:23.839637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ccc45-4893-4022-80e5-0b13cca93d4f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:23.841207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:23 2022] GET /identity/v3/users/76a491a3cc6546888fbf514517cd658a => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:23.846623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ccc45-4893-4022-80e5-0b13cca93d4f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:23.883865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a6b5e-0f3c-4b39-a7f1-cdde1a30e6ca None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:23.919601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:23.920229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:23.920507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:23.920778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:23.931260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:23.932728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:07:23.950831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:23.951727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:07:23.952539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:07:23.952539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:07:23.952539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:23.952539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:07:23.958166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:23.960248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ccc45-4893-4022-80e5-0b13cca93d4f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:23.994633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdec68-b8e5-406c-a674-a243d4192947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:23.995284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdec68-b8e5-406c-a674-a243d4192947 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:23.995557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdec68-b8e5-406c-a674-a243d4192947 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:23.995834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdec68-b8e5-406c-a674-a243d4192947 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:23.997043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdec68-b8e5-406c-a674-a243d4192947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:23.998532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdec68-b8e5-406c-a674-a243d4192947 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:24.000100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:24.005853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdec68-b8e5-406c-a674-a243d4192947 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:24.038617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:24.065928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661058-1ef0-402d-9883-b8fae05b3a0e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:24.068429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:24.105550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea53e3-723a-4fe0-a45e-54076337e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:24.106181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea53e3-723a-4fe0-a45e-54076337e99b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:24.106472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea53e3-723a-4fe0-a45e-54076337e99b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:24.106751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea53e3-723a-4fe0-a45e-54076337e99b None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:24.107421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea53e3-723a-4fe0-a45e-54076337e99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:24.107757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea53e3-723a-4fe0-a45e-54076337e99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:24.109194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea53e3-723a-4fe0-a45e-54076337e99b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:24.125643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdec68-b8e5-406c-a674-a243d4192947 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:24.127712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:24.172033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e2ac6-09bd-47e9-b6a4-d18999f68f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:24.172669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e2ac6-09bd-47e9-b6a4-d18999f68f09 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:24.172960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e2ac6-09bd-47e9-b6a4-d18999f68f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:24.173238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e2ac6-09bd-47e9-b6a4-d18999f68f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:24.174024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e2ac6-09bd-47e9-b6a4-d18999f68f09 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.domain.id=default, user.id=76a491a3cc6546888fbf514517cd658a) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:24.174345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e2ac6-09bd-47e9-b6a4-d18999f68f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:24.175847 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e2ac6-09bd-47e9-b6a4-d18999f68f09 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:24.188684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Oct 6 12:07:24 2022] GET /identity/v3/role_assignments?user.id=76a491a3cc6546888fbf514517cd658a&scope.domain.id=default&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 233 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:26.877331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6daf0-79dc-4dff-a9b4-1515ec406a49 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:26.878128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6daf0-79dc-4dff-a9b4-1515ec406a49 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:26.878128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6daf0-79dc-4dff-a9b4-1515ec406a49 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:26.879685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:26.884388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2615-1ea2-4a4b-a5fd-521698825bda None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:26.884893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2615-1ea2-4a4b-a5fd-521698825bda None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:26.884893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2615-1ea2-4a4b-a5fd-521698825bda None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:26.885784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e62e-ff5b-41ff-8dc2-25dd35ac2f25 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:26.886076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e62e-ff5b-41ff-8dc2-25dd35ac2f25 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:26.886357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e62e-ff5b-41ff-8dc2-25dd35ac2f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:26.886557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 12/23] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:26.895596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:26.895903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:26.896158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:26.915993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9b46e62e-ff5b-41ff-8dc2-25dd35ac2f25 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:26.917842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9b46e62e-ff5b-41ff-8dc2-25dd35ac2f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:26.924603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81449) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 06 12:07:26.924994 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81449) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 06 12:07:26.998763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:27.000451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:27.055361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 12/24] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:27.110807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8786-ff5f-4880-b764-e14c1d38e2c8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:27.111128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8786-ff5f-4880-b764-e14c1d38e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:27.111366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8786-ff5f-4880-b764-e14c1d38e2c8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:27.113510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 13/25] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:07:27.119413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60036be-6d0e-4fe7-b39a-39186bf7a65b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:27.119962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60036be-6d0e-4fe7-b39a-39186bf7a65b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:27.120647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60036be-6d0e-4fe7-b39a-39186bf7a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:27.141561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 13/26] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:27.155811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c60036be-6d0e-4fe7-b39a-39186bf7a65b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:27.157273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c60036be-6d0e-4fe7-b39a-39186bf7a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:27.257755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:27.476367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:27.511183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:27.595012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f0df8-9337-4ef8-b7a4-d4746428122c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:27.634056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d670-0ec1-4a00-838c-ae8834c0df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:27.634945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d670-0ec1-4a00-838c-ae8834c0df31 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:27.635231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d670-0ec1-4a00-838c-ae8834c0df31 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:27.635505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d670-0ec1-4a00-838c-ae8834c0df31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:27.646415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6d670-0ec1-4a00-838c-ae8834c0df31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d8e6d670-0ec1-4a00-838c-ae8834c0df31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:27.651536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:27.652378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:27.653168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 14/28] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:07:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:07:27.658464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60036be-6d0e-4fe7-b39a-39186bf7a65b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:27.667705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d670-0ec1-4a00-838c-ae8834c0df31 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:27.728562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:27.801924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:27.830901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d670-0ec1-4a00-838c-ae8834c0df31 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:27.883746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60036be-6d0e-4fe7-b39a-39186bf7a65b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:27.897327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:27.898017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:27.898266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:27.898552 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:27.924598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:27.926266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:27.936246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d01929-7796-42d7-8bd1-0c9fe4d72b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:27.936860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01929-7796-42d7-8bd1-0c9fe4d72b72 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:27.937136 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01929-7796-42d7-8bd1-0c9fe4d72b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:27.937412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01929-7796-42d7-8bd1-0c9fe4d72b72 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:27.938107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d01929-7796-42d7-8bd1-0c9fe4d72b72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:27.938409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d01929-7796-42d7-8bd1-0c9fe4d72b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:27.939776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d01929-7796-42d7-8bd1-0c9fe4d72b72 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:07:27.945966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:27.946848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:07:27.947730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:07:27.947730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:07:27.947730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:27.949521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 15/29] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:07:27.950547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:27.952810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 15/30] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:27.958237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962e37-6050-494f-9a2d-80e62cc496ba None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:27.958525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962e37-6050-494f-9a2d-80e62cc496ba None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:27.958801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962e37-6050-494f-9a2d-80e62cc496ba None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:27.965435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 16/31] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:27.965435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f962e37-6050-494f-9a2d-80e62cc496ba None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:28.071024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:28.081811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b40523-c940-47df-8dcc-91320fd2d4ea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:28.098195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f962e37-6050-494f-9a2d-80e62cc496ba None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:28.128764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8c181-bed1-484f-9668-d2bd527d1b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:28.129768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c181-bed1-484f-9668-d2bd527d1b3f None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.130254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c181-bed1-484f-9668-d2bd527d1b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.130779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c181-bed1-484f-9668-d2bd527d1b3f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.132983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8c181-bed1-484f-9668-d2bd527d1b3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:28.135737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8c181-bed1-484f-9668-d2bd527d1b3f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:28.139796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:28.140571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.141005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.141425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.142231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:28.142714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:28.144310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:28.152099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:28.162975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 17/32] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:28.164059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:28.282788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf368a-f50a-4d9a-b7cf-8124320b8175 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:28.298818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 16/33] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Oct 6 12:07:27 2022] POST /identity/v3/roles => generated 219 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:07:28.300652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d13f1-fdc1-4b2d-bf3b-b1fda09c24be None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.301185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d13f1-fdc1-4b2d-bf3b-b1fda09c24be None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.301908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d13f1-fdc1-4b2d-bf3b-b1fda09c24be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.323306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0e80-ba58-4be8-a571-16063ac3e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:28.323955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0e80-ba58-4be8-a571-16063ac3e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.324301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0e80-ba58-4be8-a571-16063ac3e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.324642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0e80-ba58-4be8-a571-16063ac3e2f1 None admin] PATH_INFO: `/v3/users/76a491a3cc6546888fbf514517cd658a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.325993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c0e80-ba58-4be8-a571-16063ac3e2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=76a491a3cc6546888fbf514517cd658a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:28.327124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e3d13f1-fdc1-4b2d-bf3b-b1fda09c24be None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:28.327665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c0e80-ba58-4be8-a571-16063ac3e2f1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:28.329160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e3d13f1-fdc1-4b2d-bf3b-b1fda09c24be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:28.329324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 18/34] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:28 2022] GET /identity/v3/users/76a491a3cc6546888fbf514517cd658a => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:28.330217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0e80-ba58-4be8-a571-16063ac3e2f1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:28.368358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:28.508512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 17/35] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:28.509500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d13f1-fdc1-4b2d-bf3b-b1fda09c24be None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:28.527595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0e80-ba58-4be8-a571-16063ac3e2f1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:28.594993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cdac2-b665-4970-aeaa-e3092d60414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:28.596009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cdac2-b665-4970-aeaa-e3092d60414a None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.596480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cdac2-b665-4970-aeaa-e3092d60414a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.596989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cdac2-b665-4970-aeaa-e3092d60414a None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.597982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cdac2-b665-4970-aeaa-e3092d60414a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:28.599738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cdac2-b665-4970-aeaa-e3092d60414a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:28.646474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d13f1-fdc1-4b2d-bf3b-b1fda09c24be None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:28.675210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:28.684065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1293-3a67-4536-a22b-00ce7c23c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:28.684709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1293-3a67-4536-a22b-00ce7c23c2ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.684992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1293-3a67-4536-a22b-00ce7c23c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.685265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1293-3a67-4536-a22b-00ce7c23c2ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.686678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce1293-3a67-4536-a22b-00ce7c23c2ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:28.688347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce1293-3a67-4536-a22b-00ce7c23c2ab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:28.690139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 18/36] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:28.694977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c1bdd-42e0-4c7d-8414-a5096e63f5ea None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.694977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c1bdd-42e0-4c7d-8414-a5096e63f5ea None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.694977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c1bdd-42e0-4c7d-8414-a5096e63f5ea None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.694977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 19/37] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:28.694977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147ff6-6ad5-4ef6-9ad2-461edbce631b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.694977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147ff6-6ad5-4ef6-9ad2-461edbce631b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.695387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147ff6-6ad5-4ef6-9ad2-461edbce631b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.699581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 20/38] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:28.700597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43147ff6-6ad5-4ef6-9ad2-461edbce631b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:28.756225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:07:28 2022] POST /identity/v3/projects => generated 301 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:07:28.756225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014e3f-d98d-43ed-a8ff-0ab0f13685c7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.756225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014e3f-d98d-43ed-a8ff-0ab0f13685c7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.756225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014e3f-d98d-43ed-a8ff-0ab0f13685c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.769774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6f014e3f-d98d-43ed-a8ff-0ab0f13685c7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:28.771580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6f014e3f-d98d-43ed-a8ff-0ab0f13685c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:28.828612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43147ff6-6ad5-4ef6-9ad2-461edbce631b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:28.850692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:28.860100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:28.866238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc134b6-ca5e-445f-9f4b-9552dad559ad None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.866238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc134b6-ca5e-445f-9f4b-9552dad559ad None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.866238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc134b6-ca5e-445f-9f4b-9552dad559ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.882381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e9485-b741-41a9-b1ef-05628efa39c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:28.883058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9485-b741-41a9-b1ef-05628efa39c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:28.883344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9485-b741-41a9-b1ef-05628efa39c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:28.883624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9485-b741-41a9-b1ef-05628efa39c4 None admin] PATH_INFO: `/v3/domains/default/users/76a491a3cc6546888fbf514517cd658a/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:28.888047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e9485-b741-41a9-b1ef-05628efa39c4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=76a491a3cc6546888fbf514517cd658a, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:28.890192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e9485-b741-41a9-b1ef-05628efa39c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:28.890309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3cc134b6-ca5e-445f-9f4b-9552dad559ad None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:28.891515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3cc134b6-ca5e-445f-9f4b-9552dad559ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:28.910144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 21/41] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Oct 6 12:07:28 2022] PUT /identity/v3/domains/default/users/76a491a3cc6546888fbf514517cd658a/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:07:28.912122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e9485-b741-41a9-b1ef-05628efa39c4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:28.986533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:28.990378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:29.043072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e9485-b741-41a9-b1ef-05628efa39c4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:29.081927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d49f08-ce71-4942-8a07-50ef0f9fdd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:29.082556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d49f08-ce71-4942-8a07-50ef0f9fdd87 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:29.082842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d49f08-ce71-4942-8a07-50ef0f9fdd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:29.083119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d49f08-ce71-4942-8a07-50ef0f9fdd87 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:29.083868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d49f08-ce71-4942-8a07-50ef0f9fdd87 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:29.085649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d49f08-ce71-4942-8a07-50ef0f9fdd87 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:29.109904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 22/43] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Oct 6 12:07:28 2022] POST /identity/v3/roles => generated 225 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:07:29.224042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc134b6-ca5e-445f-9f4b-9552dad559ad None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:29.278929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d49f08-ce71-4942-8a07-50ef0f9fdd87 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:29.344472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc134b6-ca5e-445f-9f4b-9552dad559ad None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:29.376600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:29.386917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2fb03-8d97-40a0-8b62-f4bfa119d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:29.387557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2fb03-8d97-40a0-8b62-f4bfa119d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:29.387838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2fb03-8d97-40a0-8b62-f4bfa119d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:29.388108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2fb03-8d97-40a0-8b62-f4bfa119d1c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:29.390422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2fb03-8d97-40a0-8b62-f4bfa119d1c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:29.392040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2fb03-8d97-40a0-8b62-f4bfa119d1c4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:29.394244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 22/44] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:29.400036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2fb03-8d97-40a0-8b62-f4bfa119d1c4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:29.406996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d49f08-ce71-4942-8a07-50ef0f9fdd87 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:29.424807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:29.447023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9f197-bcca-47d9-93fc-a2e1ef9199f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:29.447641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9f197-bcca-47d9-93fc-a2e1ef9199f7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:29.447923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9f197-bcca-47d9-93fc-a2e1ef9199f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:29.448195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9f197-bcca-47d9-93fc-a2e1ef9199f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:29.448882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9f197-bcca-47d9-93fc-a2e1ef9199f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:29.450586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9f197-bcca-47d9-93fc-a2e1ef9199f7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:29.466832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Oct 6 12:07:29 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:07:29.524170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2fb03-8d97-40a0-8b62-f4bfa119d1c4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:29.566768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5620105-9bec-48a2-9e7d-568a0a6c4ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:29.567522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620105-9bec-48a2-9e7d-568a0a6c4ecd None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:29.567806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620105-9bec-48a2-9e7d-568a0a6c4ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:29.568081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620105-9bec-48a2-9e7d-568a0a6c4ecd None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:29.569359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5620105-9bec-48a2-9e7d-568a0a6c4ecd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:29.570882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5620105-9bec-48a2-9e7d-568a0a6c4ecd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:29.601605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:07:29 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:07:31.164487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea5967-a9d3-4e28-9e12-cc3e2b45e004 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:31.165034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea5967-a9d3-4e28-9e12-cc3e2b45e004 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:31.165034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea5967-a9d3-4e28-9e12-cc3e2b45e004 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:31.166438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:31.171892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d649-1797-44b5-9d09-aa504170c453 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:31.172334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d649-1797-44b5-9d09-aa504170c453 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:31.172450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d649-1797-44b5-9d09-aa504170c453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:31.300936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-38a9d649-1797-44b5-9d09-aa504170c453 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:31.302189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-38a9d649-1797-44b5-9d09-aa504170c453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:31.347190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:31.375584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:31.646210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea5967-a9d3-4e28-9e12-cc3e2b45e004 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:31.754756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea5967-a9d3-4e28-9e12-cc3e2b45e004 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:31.785013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3e82-402c-49e9-b521-c6b14ab2249e None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:31.785413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3e82-402c-49e9-b521-c6b14ab2249e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:31.785732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3e82-402c-49e9-b521-c6b14ab2249e None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:31.787137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 25/49] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:07:31.790264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd69d6-dd66-4b3a-877d-61b6a52556f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:31.790905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd69d6-dd66-4b3a-877d-61b6a52556f8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:31.791191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd69d6-dd66-4b3a-877d-61b6a52556f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:31.791546 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd69d6-dd66-4b3a-877d-61b6a52556f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:31.792950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aeb2a-0267-45b6-a120-69a17afb337d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:31.793235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aeb2a-0267-45b6-a120-69a17afb337d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:31.793743 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aeb2a-0267-45b6-a120-69a17afb337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:31.802413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd69d6-dd66-4b3a-877d-61b6a52556f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8dbd69d6-dd66-4b3a-877d-61b6a52556f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:31.807302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:31.808198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:31.808985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 25/50] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:31.811723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-739aeb2a-0267-45b6-a120-69a17afb337d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:31.812909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-739aeb2a-0267-45b6-a120-69a17afb337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:31.814291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd69d6-dd66-4b3a-877d-61b6a52556f8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:31.848494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:31.883874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 26/51] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:31.915566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd69d6-dd66-4b3a-877d-61b6a52556f8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:31.949190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:31.950085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:31.950376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:31.950741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:31.951423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:31.951769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:31.953413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:31.962870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 26/52] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:31.968630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aeb2a-0267-45b6-a120-69a17afb337d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:32.071035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aeb2a-0267-45b6-a120-69a17afb337d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:32.078512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:32.106619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7cc0-42c9-479e-b18a-56881861199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:32.107618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7cc0-42c9-479e-b18a-56881861199e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:32.107906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7cc0-42c9-479e-b18a-56881861199e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:32.108183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7cc0-42c9-479e-b18a-56881861199e None admin] PATH_INFO: `/v3/users/76a491a3cc6546888fbf514517cd658a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:32.109339 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7cc0-42c9-479e-b18a-56881861199e None admin] RBAC: Authorizing `identity:get_user(user_id=76a491a3cc6546888fbf514517cd658a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:32.110837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7cc0-42c9-479e-b18a-56881861199e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:32.112629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:31 2022] GET /identity/v3/users/76a491a3cc6546888fbf514517cd658a => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:32.118473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:32.151352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7cc0-42c9-479e-b18a-56881861199e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:32.260281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7cc0-42c9-479e-b18a-56881861199e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:32.297362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516e816-89fb-45fb-9aa7-11eb02595a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:32.298031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e816-89fb-45fb-9aa7-11eb02595a7d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:32.298313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e816-89fb-45fb-9aa7-11eb02595a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:32.298582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e816-89fb-45fb-9aa7-11eb02595a7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:32.299736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516e816-89fb-45fb-9aa7-11eb02595a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:32.301222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516e816-89fb-45fb-9aa7-11eb02595a7d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:32.303014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 28/54] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:32.309073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516e816-89fb-45fb-9aa7-11eb02595a7d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:32.326545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:32.330299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45920-8898-43f2-88f1-a5470f83a8a1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:32.353517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:32.364985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b7712-0936-4a9a-bbf7-0e140e35ae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:32.366306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b7712-0936-4a9a-bbf7-0e140e35ae4a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:32.366727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b7712-0936-4a9a-bbf7-0e140e35ae4a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:32.367185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b7712-0936-4a9a-bbf7-0e140e35ae4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:32.368280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b7712-0936-4a9a-bbf7-0e140e35ae4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:32.369781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b7712-0936-4a9a-bbf7-0e140e35ae4a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:32.371352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:32.377096 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b7712-0936-4a9a-bbf7-0e140e35ae4a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:32.413192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516e816-89fb-45fb-9aa7-11eb02595a7d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:32.450119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763636f3-98fd-4046-99b6-c2d9c4dea87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:32.450728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763636f3-98fd-4046-99b6-c2d9c4dea87d None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:32.451013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763636f3-98fd-4046-99b6-c2d9c4dea87d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:32.451279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763636f3-98fd-4046-99b6-c2d9c4dea87d None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:32.451960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763636f3-98fd-4046-99b6-c2d9c4dea87d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:32.453399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763636f3-98fd-4046-99b6-c2d9c4dea87d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:32.481705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 29/56] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Oct 6 12:07:32 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:07:32.481936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b7712-0936-4a9a-bbf7-0e140e35ae4a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:32.520803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ac943-3c68-4858-9724-e8ab3d3fc537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:32.521358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac943-3c68-4858-9724-e8ab3d3fc537 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:32.522236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac943-3c68-4858-9724-e8ab3d3fc537 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:32.523033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac943-3c68-4858-9724-e8ab3d3fc537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:32.523431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ac943-3c68-4858-9724-e8ab3d3fc537 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.domain.id=default, user.id=76a491a3cc6546888fbf514517cd658a) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:32.523747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ac943-3c68-4858-9724-e8ab3d3fc537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:32.525244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ac943-3c68-4858-9724-e8ab3d3fc537 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:32.532249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Oct 6 12:07:32 2022] GET /identity/v3/role_assignments?user.id=76a491a3cc6546888fbf514517cd658a&scope.domain.id=default&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:34.673784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6163-27d1-42e6-9a9b-9a5b6c49aa1d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:34.674315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6163-27d1-42e6-9a9b-9a5b6c49aa1d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:34.674315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6163-27d1-42e6-9a9b-9a5b6c49aa1d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:34.675653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 30/58] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:34.681494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f57be-1c0d-4b91-9ca5-98199dce6413 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:34.681928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f57be-1c0d-4b91-9ca5-98199dce6413 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:34.682099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f57be-1c0d-4b91-9ca5-98199dce6413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:34.702147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-832f57be-1c0d-4b91-9ca5-98199dce6413 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:34.703383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-832f57be-1c0d-4b91-9ca5-98199dce6413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:34.729939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:34.776772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:35.067191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f6163-27d1-42e6-9a9b-9a5b6c49aa1d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:35.169335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:35.179698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f6163-27d1-42e6-9a9b-9a5b6c49aa1d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:35.216284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded1f2d-1397-4cad-976d-74b5a26dd7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:35.216923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1f2d-1397-4cad-976d-74b5a26dd7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:35.217206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1f2d-1397-4cad-976d-74b5a26dd7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:35.217484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded1f2d-1397-4cad-976d-74b5a26dd7e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:35.218659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded1f2d-1397-4cad-976d-74b5a26dd7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:35.220119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded1f2d-1397-4cad-976d-74b5a26dd7e2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:35.221718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 31/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:35.227576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f57be-1c0d-4b91-9ca5-98199dce6413 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:35.326718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f57be-1c0d-4b91-9ca5-98199dce6413 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:35.370115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150931e-f66f-4081-95f6-92258cf65180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:35.370873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150931e-f66f-4081-95f6-92258cf65180 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:35.371158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150931e-f66f-4081-95f6-92258cf65180 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:35.371431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150931e-f66f-4081-95f6-92258cf65180 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:35.372103 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150931e-f66f-4081-95f6-92258cf65180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:35.373728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150931e-f66f-4081-95f6-92258cf65180 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:35.404648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 30/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:07:35 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:07:39.205041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3443e3-048b-4340-9851-985248d0428d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.206042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3443e3-048b-4340-9851-985248d0428d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.206534 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3443e3-048b-4340-9851-985248d0428d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.208409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 32/62] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:39.214594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ce6d-5481-4ec1-b21d-93672f13c9d2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.215502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ce6d-5481-4ec1-b21d-93672f13c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.215997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ce6d-5481-4ec1-b21d-93672f13c9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.242636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc69de-c8a1-42d8-b2a3-526458719867 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.243253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc69de-c8a1-42d8-b2a3-526458719867 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.243726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc69de-c8a1-42d8-b2a3-526458719867 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.245277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 33/63] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:07:39.247841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3cf6ce6d-5481-4ec1-b21d-93672f13c9d2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:39.249294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3cf6ce6d-5481-4ec1-b21d-93672f13c9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:39.253266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9426-a74f-48a4-a670-968ae643e032 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.254088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9426-a74f-48a4-a670-968ae643e032 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.254785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9426-a74f-48a4-a670-968ae643e032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.273597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:39.299546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1d8a9426-a74f-48a4-a670-968ae643e032 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:39.300790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1d8a9426-a74f-48a4-a670-968ae643e032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:39.376438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 31/64] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:39.400481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e367-6d2e-4db7-9f16-f6f7ae2a4d74 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.401341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e367-6d2e-4db7-9f16-f6f7ae2a4d74 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.401880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e367-6d2e-4db7-9f16-f6f7ae2a4d74 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.403461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 32/65] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:07:39.408629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844f03-8474-49e2-b9cc-b82e5d4bed8b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.409181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844f03-8474-49e2-b9cc-b82e5d4bed8b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.409713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844f03-8474-49e2-b9cc-b82e5d4bed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.439518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-89844f03-8474-49e2-b9cc-b82e5d4bed8b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:39.442547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-89844f03-8474-49e2-b9cc-b82e5d4bed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:39.465789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 34/66] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:39.467975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607163-086c-4a21-b04b-98992881daa1 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.468481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607163-086c-4a21-b04b-98992881daa1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.468974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22607163-086c-4a21-b04b-98992881daa1 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.470986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 35/67] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:39.481563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6f64b-7994-4fe0-b076-c9b5fc1b95e0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.481563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6f64b-7994-4fe0-b076-c9b5fc1b95e0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.481563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6f64b-7994-4fe0-b076-c9b5fc1b95e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.516086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-85b6f64b-7994-4fe0-b076-c9b5fc1b95e0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:39.517291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-85b6f64b-7994-4fe0-b076-c9b5fc1b95e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:39.610755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 33/68] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:39.679460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 36/69] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:39.751420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d98a1-d382-4c48-99f3-a31f72ef9f7d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.751708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d98a1-d382-4c48-99f3-a31f72ef9f7d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.752143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d98a1-d382-4c48-99f3-a31f72ef9f7d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.753909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 34/70] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:39.760258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52be45-b480-4ad9-b638-0b2e027c4d4f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:39.760548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52be45-b480-4ad9-b638-0b2e027c4d4f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:39.760831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52be45-b480-4ad9-b638-0b2e027c4d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:39.786586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-dd52be45-b480-4ad9-b638-0b2e027c4d4f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:39.788424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dd52be45-b480-4ad9-b638-0b2e027c4d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:39.807691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d98a1-d382-4c48-99f3-a31f72ef9f7d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:39.808772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:39.885843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 37/71] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:39.896057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52be45-b480-4ad9-b638-0b2e027c4d4f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:39.953228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:39.986032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d98a1-d382-4c48-99f3-a31f72ef9f7d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.040841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6354e3-e47f-40d2-b4fb-394e4a713b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.041685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6354e3-e47f-40d2-b4fb-394e4a713b7f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.041976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6354e3-e47f-40d2-b4fb-394e4a713b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.042252 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6354e3-e47f-40d2-b4fb-394e4a713b7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.052292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52be45-b480-4ad9-b638-0b2e027c4d4f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.055670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6354e3-e47f-40d2-b4fb-394e4a713b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ed6354e3-e47f-40d2-b4fb-394e4a713b7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:40.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:40.061924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:40.062695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:40.065116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 35/72] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:40.066207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6354e3-e47f-40d2-b4fb-394e4a713b7f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.104865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302edf2-145d-4ae1-a6b5-d31981530f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.105643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302edf2-145d-4ae1-a6b5-d31981530f63 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.106000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302edf2-145d-4ae1-a6b5-d31981530f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.106348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302edf2-145d-4ae1-a6b5-d31981530f63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.119903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302edf2-145d-4ae1-a6b5-d31981530f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c302edf2-145d-4ae1-a6b5-d31981530f63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:40.127157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:40.128087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:40.128843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:40.131857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 38/73] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:40.133165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302edf2-145d-4ae1-a6b5-d31981530f63 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.150074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:40.199430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6354e3-e47f-40d2-b4fb-394e4a713b7f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.247461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53547e02-e351-4263-989d-84fd7d67187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.248434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53547e02-e351-4263-989d-84fd7d67187a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.248741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53547e02-e351-4263-989d-84fd7d67187a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.249119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53547e02-e351-4263-989d-84fd7d67187a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.249273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302edf2-145d-4ae1-a6b5-d31981530f63 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.252540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:40.262866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53547e02-e351-4263-989d-84fd7d67187a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-53547e02-e351-4263-989d-84fd7d67187a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:40.267743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:40.268631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:40.269387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 36/74] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:40.270049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53547e02-e351-4263-989d-84fd7d67187a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.291886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.292553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.292842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.293124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.293853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:40.294166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:40.295595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:40.307166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 39/75] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:40.308055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.398496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53547e02-e351-4263-989d-84fd7d67187a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.401782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:40.432927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eca5d-2e15-4aa5-834d-ad22159eb7f0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.436045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fb94-119a-4b9f-930b-df188d30c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.436688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fb94-119a-4b9f-930b-df188d30c734 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.436978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fb94-119a-4b9f-930b-df188d30c734 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.437260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fb94-119a-4b9f-930b-df188d30c734 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.448250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0fb94-119a-4b9f-930b-df188d30c734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d0e0fb94-119a-4b9f-930b-df188d30c734 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:40.453261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:40.454186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 37/76] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:40.460195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fb94-119a-4b9f-930b-df188d30c734 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.470978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.471600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.471881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.472151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.472816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:40.473118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:40.474641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:40.484020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 40/77] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:40.486505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.515628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:40.563410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fb94-119a-4b9f-930b-df188d30c734 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.596215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9ceb-10f3-4dfd-b318-c0cb7faba856 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.598456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c59abc-b02d-4233-9cb2-87e1382eb22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.599100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c59abc-b02d-4233-9cb2-87e1382eb22a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.599384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c59abc-b02d-4233-9cb2-87e1382eb22a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.599659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c59abc-b02d-4233-9cb2-87e1382eb22a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.601384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c59abc-b02d-4233-9cb2-87e1382eb22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:40.603043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c59abc-b02d-4233-9cb2-87e1382eb22a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:40.604635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 38/78] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:40.605413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c59abc-b02d-4233-9cb2-87e1382eb22a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.640306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.640932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.641219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.641499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.642209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:40.642521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:40.643932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:40.646378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:40.656059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 41/79] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:40.656856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.721381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c59abc-b02d-4233-9cb2-87e1382eb22a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.753812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:40.760178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f06079-7c6f-4e45-bba8-2a720fea06cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.760817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f06079-7c6f-4e45-bba8-2a720fea06cd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.761104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f06079-7c6f-4e45-bba8-2a720fea06cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.761398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f06079-7c6f-4e45-bba8-2a720fea06cd None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.763899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cba832-07fb-4683-85b5-76c44465de43 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.777757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f06079-7c6f-4e45-bba8-2a720fea06cd None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:40.779142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f06079-7c6f-4e45-bba8-2a720fea06cd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:40.780823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 39/80] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:40.781626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f06079-7c6f-4e45-bba8-2a720fea06cd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.798755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.799379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.799669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.799946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.800641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:40.800979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:40.802405 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:40.811368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 42/81] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:40.812199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.876342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:40.889794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f06079-7c6f-4e45-bba8-2a720fea06cd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.921051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1278e-b221-4566-a685-8ce461649b78 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:40.923457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938aac9-6803-4b2e-8195-94a1bdf80f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.924095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938aac9-6803-4b2e-8195-94a1bdf80f95 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.924378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938aac9-6803-4b2e-8195-94a1bdf80f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.924653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938aac9-6803-4b2e-8195-94a1bdf80f95 None admin] PATH_INFO: `/v3/users/76a491a3cc6546888fbf514517cd658a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.925842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938aac9-6803-4b2e-8195-94a1bdf80f95 None admin] RBAC: Authorizing `identity:get_user(user_id=76a491a3cc6546888fbf514517cd658a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:40.927286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938aac9-6803-4b2e-8195-94a1bdf80f95 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:40.929428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 40/82] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/users/76a491a3cc6546888fbf514517cd658a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:40.930303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938aac9-6803-4b2e-8195-94a1bdf80f95 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:40.962415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc74908-f017-4123-b2a2-df926707612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:40.963036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc74908-f017-4123-b2a2-df926707612d None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:40.963321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc74908-f017-4123-b2a2-df926707612d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:40.963602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc74908-f017-4123-b2a2-df926707612d None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:40.964271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc74908-f017-4123-b2a2-df926707612d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:40.965822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc74908-f017-4123-b2a2-df926707612d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:40.984120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:40.997580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 43/83] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:07:40 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:07:40.997580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc74908-f017-4123-b2a2-df926707612d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:41.063633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938aac9-6803-4b2e-8195-94a1bdf80f95 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:41.112389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bba378-9d0a-4daf-bbc2-ccb75e4b7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:41.113094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bba378-9d0a-4daf-bbc2-ccb75e4b7ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:41.113467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bba378-9d0a-4daf-bbc2-ccb75e4b7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:41.113824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bba378-9d0a-4daf-bbc2-ccb75e4b7ec1 None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:41.115118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bba378-9d0a-4daf-bbc2-ccb75e4b7ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:41.118090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bba378-9d0a-4daf-bbc2-ccb75e4b7ec1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:41.120950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 41/84] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:41.122158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bba378-9d0a-4daf-bbc2-ccb75e4b7ec1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:41.138720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc74908-f017-4123-b2a2-df926707612d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:41.162860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:41.186866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a880483-982c-419b-9db5-74b9da16d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:41.187233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a880483-982c-419b-9db5-74b9da16d469 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:41.187520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a880483-982c-419b-9db5-74b9da16d469 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:41.187798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a880483-982c-419b-9db5-74b9da16d469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:41.262638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bba378-9d0a-4daf-bbc2-ccb75e4b7ec1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:41.281721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a880483-982c-419b-9db5-74b9da16d469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:41.283903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a880483-982c-419b-9db5-74b9da16d469 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:41.292582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:41.318391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0201df0-215c-4fa1-b55c-5961e7607a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:41.319024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201df0-215c-4fa1-b55c-5961e7607a51 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:41.319312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201df0-215c-4fa1-b55c-5961e7607a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:41.319595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0201df0-215c-4fa1-b55c-5961e7607a51 None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:41.320809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0201df0-215c-4fa1-b55c-5961e7607a51 None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:41.322442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0201df0-215c-4fa1-b55c-5961e7607a51 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:41.324083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 42/85] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:41 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:41.325173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0201df0-215c-4fa1-b55c-5961e7607a51 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:41.440263 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 44/86] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:41.441549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a880483-982c-419b-9db5-74b9da16d469 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:41.460834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0201df0-215c-4fa1-b55c-5961e7607a51 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:41.466231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:41.503750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f01f5-9f87-4b2f-8e7b-15b1e2354420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:41.504463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f01f5-9f87-4b2f-8e7b-15b1e2354420 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:41.504746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f01f5-9f87-4b2f-8e7b-15b1e2354420 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:41.505023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f01f5-9f87-4b2f-8e7b-15b1e2354420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:41.575071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:41.585122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a880483-982c-419b-9db5-74b9da16d469 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:41.591069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f01f5-9f87-4b2f-8e7b-15b1e2354420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:41.592716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f01f5-9f87-4b2f-8e7b-15b1e2354420 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:41.632130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c55fa-892f-46f6-aea6-4cb12391483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:41.633000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c55fa-892f-46f6-aea6-4cb12391483d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:41.633374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c55fa-892f-46f6-aea6-4cb12391483d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:41.633768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c55fa-892f-46f6-aea6-4cb12391483d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:41.711244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c55fa-892f-46f6-aea6-4cb12391483d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:41.712917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c55fa-892f-46f6-aea6-4cb12391483d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:41.723424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 43/87] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:41.724201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f01f5-9f87-4b2f-8e7b-15b1e2354420 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:41.732559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:41.819711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 45/88] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:41.820581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c55fa-892f-46f6-aea6-4cb12391483d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:41.831375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:41.851524 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f01f5-9f87-4b2f-8e7b-15b1e2354420 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:41.893113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816015-8dda-44f5-881a-b51c77e6a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:41.893771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816015-8dda-44f5-881a-b51c77e6a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:41.894157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816015-8dda-44f5-881a-b51c77e6a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:41.894443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816015-8dda-44f5-881a-b51c77e6a8a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:41.929575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c55fa-892f-46f6-aea6-4cb12391483d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:41.948170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:41.970409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d655d3c-d23f-448e-a9ab-58bc506ff4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:41.971219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d655d3c-d23f-448e-a9ab-58bc506ff4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:41.971598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d655d3c-d23f-448e-a9ab-58bc506ff4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:41.972013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d655d3c-d23f-448e-a9ab-58bc506ff4f2 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:41.973296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d655d3c-d23f-448e-a9ab-58bc506ff4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:41.975515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d655d3c-d23f-448e-a9ab-58bc506ff4f2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:41.977424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 46/89] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:41 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:41.977921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e816015-8dda-44f5-881a-b51c77e6a8a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:41.978440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d655d3c-d23f-448e-a9ab-58bc506ff4f2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:41.979417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e816015-8dda-44f5-881a-b51c77e6a8a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:42.084596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:42.090746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d655d3c-d23f-448e-a9ab-58bc506ff4f2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:42.104474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 44/90] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:42.105348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816015-8dda-44f5-881a-b51c77e6a8a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:42.146322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340c39-89d1-417c-9e26-a91562d413ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:42.147310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340c39-89d1-417c-9e26-a91562d413ed None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:42.147735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340c39-89d1-417c-9e26-a91562d413ed None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:42.148151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340c39-89d1-417c-9e26-a91562d413ed None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:42.149492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29340c39-89d1-417c-9e26-a91562d413ed None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:42.151382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29340c39-89d1-417c-9e26-a91562d413ed None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:42.153182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 47/91] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:41 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:42.154407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340c39-89d1-417c-9e26-a91562d413ed None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:42.213514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:42.235725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816015-8dda-44f5-881a-b51c77e6a8a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:42.270561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340c39-89d1-417c-9e26-a91562d413ed None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:42.278456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32353-8694-47d0-b940-a19d081957d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:42.279104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32353-8694-47d0-b940-a19d081957d6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:42.279394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32353-8694-47d0-b940-a19d081957d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:42.279673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32353-8694-47d0-b940-a19d081957d6 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:42.280941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce32353-8694-47d0-b940-a19d081957d6 None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:42.282302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce32353-8694-47d0-b940-a19d081957d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:42.284228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 45/92] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:42 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:42.285223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32353-8694-47d0-b940-a19d081957d6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:42.311479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:42.312665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:42.313086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:42.313495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:42.314378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] RBAC: Adding query filter params (role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user.id=4566f2276f01462e910e3412f7107cd6) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:42.314926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:42.316591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:42.324318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 48/93] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:42 2022] GET /identity/v3/role_assignments?user.id=4566f2276f01462e910e3412f7107cd6&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:42.325511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:42.353287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:42.410772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32353-8694-47d0-b940-a19d081957d6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:42.445797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb760fc-42a7-4bdf-b2d7-6ce775bb4aaf None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:42.452104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6356bd-b0a0-4773-8fa0-1d7c3a74889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:42.452771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6356bd-b0a0-4773-8fa0-1d7c3a74889a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:42.453060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6356bd-b0a0-4773-8fa0-1d7c3a74889a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:42.453342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6356bd-b0a0-4773-8fa0-1d7c3a74889a None admin] PATH_INFO: `/v3/projects/264b02e7c85f472ba781c71c018222e8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:42.454654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6356bd-b0a0-4773-8fa0-1d7c3a74889a None admin] RBAC: Authorizing `identity:get_project(project_id=264b02e7c85f472ba781c71c018222e8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:42.456185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6356bd-b0a0-4773-8fa0-1d7c3a74889a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:42.458172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 46/94] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:42 2022] GET /identity/v3/projects/264b02e7c85f472ba781c71c018222e8 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:42.459018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6356bd-b0a0-4773-8fa0-1d7c3a74889a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:42.470835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:42.493511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:42.494613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:42.495186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:42.495703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:42.496709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user.id=76a491a3cc6546888fbf514517cd658a) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:42.497359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:42.499188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:42.505952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 49/95] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:42 2022] GET /identity/v3/role_assignments?user.id=76a491a3cc6546888fbf514517cd658a&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:42.507229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:42.590248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6356bd-b0a0-4773-8fa0-1d7c3a74889a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:42.620984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:42.640677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f044dec-b28b-4389-932f-fb4bb9026827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:42.641329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f044dec-b28b-4389-932f-fb4bb9026827 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:42.641644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f044dec-b28b-4389-932f-fb4bb9026827 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:42.645621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f044dec-b28b-4389-932f-fb4bb9026827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:42.646577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f044dec-b28b-4389-932f-fb4bb9026827 None admin] RBAC: Adding query filter params (role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user.id=4566f2276f01462e910e3412f7107cd6) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:42.646940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f044dec-b28b-4389-932f-fb4bb9026827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:42.648436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f044dec-b28b-4389-932f-fb4bb9026827 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:42.660408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 47/96] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:42 2022] GET /identity/v3/role_assignments?user.id=4566f2276f01462e910e3412f7107cd6&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:42.678327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5e0a1-eb85-4752-93e3-0737817e547d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:42.745523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c01c1-0007-48ce-a2c7-62b054a199f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:42.746201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c01c1-0007-48ce-a2c7-62b054a199f1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:42.746488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c01c1-0007-48ce-a2c7-62b054a199f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:42.746781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c01c1-0007-48ce-a2c7-62b054a199f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:42.747566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c01c1-0007-48ce-a2c7-62b054a199f1 None admin] RBAC: Adding query filter params (role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=264b02e7c85f472ba781c71c018222e8, user.id=4566f2276f01462e910e3412f7107cd6) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:42.747887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c01c1-0007-48ce-a2c7-62b054a199f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:42.749464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c01c1-0007-48ce-a2c7-62b054a199f1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:42.759125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 50/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:42 2022] GET /identity/v3/role_assignments?user.id=4566f2276f01462e910e3412f7107cd6&scope.project.id=264b02e7c85f472ba781c71c018222e8&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:44.312881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc923e4-18c2-4923-8bd2-192230dab2bc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:44.313393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc923e4-18c2-4923-8bd2-192230dab2bc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:44.313466 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc923e4-18c2-4923-8bd2-192230dab2bc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:44.314829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 48/98] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:44.321059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73ac9-bb9a-439b-aa6e-0e71af9261fe None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:44.322116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73ac9-bb9a-439b-aa6e-0e71af9261fe None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:44.322604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73ac9-bb9a-439b-aa6e-0e71af9261fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:44.351192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d7c73ac9-bb9a-439b-aa6e-0e71af9261fe None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:44.352812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d7c73ac9-bb9a-439b-aa6e-0e71af9261fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:44.408259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:44.444002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 51/99] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:44.516164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bcc61-d6a4-46a1-b605-caed648b2e2c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:44.516805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bcc61-d6a4-46a1-b605-caed648b2e2c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:44.517282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bcc61-d6a4-46a1-b605-caed648b2e2c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:44.519326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 49/100] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:44.526422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8abdd-9bcf-45a9-9104-a81ecdaab953 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:44.526775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8abdd-9bcf-45a9-9104-a81ecdaab953 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:44.526993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8abdd-9bcf-45a9-9104-a81ecdaab953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:44.556399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c7c8abdd-9bcf-45a9-9104-a81ecdaab953 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:44.557644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c7c8abdd-9bcf-45a9-9104-a81ecdaab953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:44.651470 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 52/101] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:44.871217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bcc61-d6a4-46a1-b605-caed648b2e2c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:45.013375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bcc61-d6a4-46a1-b605-caed648b2e2c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:45.049398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8796c-f0a6-494d-8fd8-25dcbd3cf2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:45.050455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8796c-f0a6-494d-8fd8-25dcbd3cf2ec None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:45.050965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8796c-f0a6-494d-8fd8-25dcbd3cf2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:45.051433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8796c-f0a6-494d-8fd8-25dcbd3cf2ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:45.052878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8796c-f0a6-494d-8fd8-25dcbd3cf2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:45.054655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8796c-f0a6-494d-8fd8-25dcbd3cf2ec None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:45.056479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 50/102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:45.062235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8abdd-9bcf-45a9-9104-a81ecdaab953 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:45.214639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8abdd-9bcf-45a9-9104-a81ecdaab953 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:45.216992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:45.251317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c086d-5c30-411b-b83d-b5e4e83c7312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:45.252013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c086d-5c30-411b-b83d-b5e4e83c7312 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:45.252298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c086d-5c30-411b-b83d-b5e4e83c7312 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:45.252573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c086d-5c30-411b-b83d-b5e4e83c7312 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:45.253248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c086d-5c30-411b-b83d-b5e4e83c7312 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:45.254879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c086d-5c30-411b-b83d-b5e4e83c7312 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:45.283002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8796c-f0a6-494d-8fd8-25dcbd3cf2ec None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:45.290934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 53/103] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:07:45 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:07:45.376902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:45.436324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8796c-f0a6-494d-8fd8-25dcbd3cf2ec None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:45.485897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e83e98-8223-4409-a7d4-0e89c60a9deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:45.486920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83e98-8223-4409-a7d4-0e89c60a9deb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:45.487437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83e98-8223-4409-a7d4-0e89c60a9deb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:45.487912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83e98-8223-4409-a7d4-0e89c60a9deb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:45.506900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e83e98-8223-4409-a7d4-0e89c60a9deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a7e83e98-8223-4409-a7d4-0e89c60a9deb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:45.512434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:45.513390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:07:45.514248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:45.516707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 51/104] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:07:45.525064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c086d-5c30-411b-b83d-b5e4e83c7312 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:45.604276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec87e-ea24-45a8-8e70-f1ca26e1fecc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:45.604862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec87e-ea24-45a8-8e70-f1ca26e1fecc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:45.605220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec87e-ea24-45a8-8e70-f1ca26e1fecc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:45.607641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 52/105] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:07:45.617137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebe790-7efa-4f68-868d-79c98fd24459 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:45.617516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebe790-7efa-4f68-868d-79c98fd24459 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:45.617887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebe790-7efa-4f68-868d-79c98fd24459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:45.681631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-72ebe790-7efa-4f68-868d-79c98fd24459 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:45.683928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-72ebe790-7efa-4f68-868d-79c98fd24459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:45.799195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c086d-5c30-411b-b83d-b5e4e83c7312 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:45.853510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 53/106] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 06 12:07:45.861561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8831e-ca99-40c8-a1d1-b4f7ac27812a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:45.861561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8831e-ca99-40c8-a1d1-b4f7ac27812a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:45.861561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8831e-ca99-40c8-a1d1-b4f7ac27812a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:45.861561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 54/107] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:45.863622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:45.864663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:45.865157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:45.868430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013af28-846a-4575-9047-8c6bc9ce5897 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:45.868907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013af28-846a-4575-9047-8c6bc9ce5897 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:45.869401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013af28-846a-4575-9047-8c6bc9ce5897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:45.874130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:45.875503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:45.876049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:45.879607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:45.911507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 54/108] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:45.918611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:45.926289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1013af28-846a-4575-9047-8c6bc9ce5897 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:45.928367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1013af28-846a-4575-9047-8c6bc9ce5897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:45.978685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:46.031388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:46.082295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 55/109] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:46.086335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887e81-008a-46c6-91bf-0fffa3f80467 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.086637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887e81-008a-46c6-91bf-0fffa3f80467 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.086925 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887e81-008a-46c6-91bf-0fffa3f80467 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.094215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 56/110] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:46.097412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244f2b-47fb-4af1-b664-0508a3f98856 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.097412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244f2b-47fb-4af1-b664-0508a3f98856 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.097412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244f2b-47fb-4af1-b664-0508a3f98856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.139712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-47244f2b-47fb-4af1-b664-0508a3f98856 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:46.142557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47244f2b-47fb-4af1-b664-0508a3f98856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:46.167206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e016-b8d8-40b8-99c9-4f79f1673d3f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:46.206000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1812-1678-48a8-b46e-eae49f2c1f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:46.206929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1812-1678-48a8-b46e-eae49f2c1f9a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.207295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1812-1678-48a8-b46e-eae49f2c1f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.207579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1812-1678-48a8-b46e-eae49f2c1f9a None admin] PATH_INFO: `/v3/users/1ab8a20f37e644369f7d461fa6598805` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.223291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c1812-1678-48a8-b46e-eae49f2c1f9a None admin] RBAC: Authorizing `identity:get_user(user_id=1ab8a20f37e644369f7d461fa6598805)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:46.224982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c1812-1678-48a8-b46e-eae49f2c1f9a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:46.227148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 55/111] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:45 2022] GET /identity/v3/users/1ab8a20f37e644369f7d461fa6598805 => generated 289 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:46.233040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1812-1678-48a8-b46e-eae49f2c1f9a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:46.299909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 57/112] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:46.301009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244f2b-47fb-4af1-b664-0508a3f98856 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:46.355463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:46.384768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1812-1678-48a8-b46e-eae49f2c1f9a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:46.453774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e8193-7706-4f82-b72f-8ebad84a291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:46.454406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e8193-7706-4f82-b72f-8ebad84a291f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.454697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e8193-7706-4f82-b72f-8ebad84a291f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.454979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e8193-7706-4f82-b72f-8ebad84a291f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.457608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244f2b-47fb-4af1-b664-0508a3f98856 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:46.463110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:46.539618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1b69f-2d9c-445a-9266-2577b2cca606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:46.540276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1b69f-2d9c-445a-9266-2577b2cca606 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.540565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1b69f-2d9c-445a-9266-2577b2cca606 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.540848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1b69f-2d9c-445a-9266-2577b2cca606 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.559865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1b69f-2d9c-445a-9266-2577b2cca606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cca1b69f-2d9c-445a-9266-2577b2cca606 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:46.565278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:46.566175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:46.566937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:46.570187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 58/113] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:46.572455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce3cbf-19b6-4b7a-a562-40d2066f2fbb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.572896 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce3cbf-19b6-4b7a-a562-40d2066f2fbb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.573342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce3cbf-19b6-4b7a-a562-40d2066f2fbb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.575028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 59/114] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:46.576107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce3cbf-19b6-4b7a-a562-40d2066f2fbb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:46.583868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e8193-7706-4f82-b72f-8ebad84a291f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:46.586236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e8193-7706-4f82-b72f-8ebad84a291f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:46.670963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:46.699525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 56/115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 12:07:46.700408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e8193-7706-4f82-b72f-8ebad84a291f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:46.702397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce3cbf-19b6-4b7a-a562-40d2066f2fbb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:46.745491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd9c9-c2ac-4e88-8b9c-8c2c8d9fc903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:46.746258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd9c9-c2ac-4e88-8b9c-8c2c8d9fc903 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.746551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd9c9-c2ac-4e88-8b9c-8c2c8d9fc903 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.746833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd9c9-c2ac-4e88-8b9c-8c2c8d9fc903 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.759168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bd9c9-c2ac-4e88-8b9c-8c2c8d9fc903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b34bd9c9-c2ac-4e88-8b9c-8c2c8d9fc903 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:46.764757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:46.765737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 60/116] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:46.771991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33177a-89f9-431c-83c8-0675aaee8df8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.772691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33177a-89f9-431c-83c8-0675aaee8df8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.772691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33177a-89f9-431c-83c8-0675aaee8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.788097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2a33177a-89f9-431c-83c8-0675aaee8df8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:46.790029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2a33177a-89f9-431c-83c8-0675aaee8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:46.816071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:46.829873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e8193-7706-4f82-b72f-8ebad84a291f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:46.867845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:46.868460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:46.868736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:46.869009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:46.869707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:46.870014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:46.871441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:46.873750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 61/117] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:46.874500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33177a-89f9-431c-83c8-0675aaee8df8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:46.899718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 57/118] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:46.900483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:46.954561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:46.992007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33177a-89f9-431c-83c8-0675aaee8df8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.028213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569939-ef6f-4605-9f40-952f772ee177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.028859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569939-ef6f-4605-9f40-952f772ee177 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.029216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569939-ef6f-4605-9f40-952f772ee177 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.029420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569939-ef6f-4605-9f40-952f772ee177 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.040816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10569939-ef6f-4605-9f40-952f772ee177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:47.043335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8d574-9b1e-4db9-931d-4896dd8d365c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-10569939-ef6f-4605-9f40-952f772ee177 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:47.046627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:47.047507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:47.048259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 62/119] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:07:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:47.048897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569939-ef6f-4605-9f40-952f772ee177 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.070054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:47.086113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4d418-82dd-483d-bc16-7437de36a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.086999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4d418-82dd-483d-bc16-7437de36a68c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.087530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4d418-82dd-483d-bc16-7437de36a68c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.087870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4d418-82dd-483d-bc16-7437de36a68c None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.089224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4d418-82dd-483d-bc16-7437de36a68c None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.091022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4d418-82dd-483d-bc16-7437de36a68c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.092882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 58/120] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:46 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.093825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4d418-82dd-483d-bc16-7437de36a68c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.184933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569939-ef6f-4605-9f40-952f772ee177 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.208883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4d418-82dd-483d-bc16-7437de36a68c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.217510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:47.229569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.230224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.230523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.230832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.231651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:47.231997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.233689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.244930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 63/121] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.250087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.256757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6644-8724-43ae-bdce-160f17e7818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.257481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6644-8724-43ae-bdce-160f17e7818f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.257868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6644-8724-43ae-bdce-160f17e7818f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.258219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6644-8724-43ae-bdce-160f17e7818f None admin] PATH_INFO: `/v3/users/76a491a3cc6546888fbf514517cd658a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.259452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c6644-8724-43ae-bdce-160f17e7818f None admin] RBAC: Authorizing `identity:get_user(user_id=76a491a3cc6546888fbf514517cd658a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.260985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c6644-8724-43ae-bdce-160f17e7818f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.267828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 59/122] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/users/76a491a3cc6546888fbf514517cd658a => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.267828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6644-8724-43ae-bdce-160f17e7818f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.343112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:47.367666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039248cc-e534-4ba3-af6f-cc5acb4bcd39 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.394523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6644-8724-43ae-bdce-160f17e7818f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.403594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.404583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.404875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.405157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.406244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:47.406352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.407755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.422431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 64/123] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.422431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.437224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.437911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.438304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.438624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.439338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] RBAC: Adding query filter params (role.id=42427d2d58f0468cb0d9d1d3e97617a7, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user.id=1ab8a20f37e644369f7d461fa6598805) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:47.439652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.441191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.447397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 60/124] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/role_assignments?user.id=1ab8a20f37e644369f7d461fa6598805&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=42427d2d58f0468cb0d9d1d3e97617a7 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.448225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.507058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:47.574021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbd64-32a6-4c42-9f97-c66b871c0b75 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.590810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d6297-9fbc-493d-bd5a-2f5c76378689 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.630950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c2c84-e35f-437d-85fd-0daadddbb5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.632655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2c84-e35f-437d-85fd-0daadddbb5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.632655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2c84-e35f-437d-85fd-0daadddbb5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.632655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2c84-e35f-437d-85fd-0daadddbb5a5 None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.633942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c2c84-e35f-437d-85fd-0daadddbb5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.635325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c2c84-e35f-437d-85fd-0daadddbb5a5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.636842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 65/125] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.637661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf7bb8-e867-4b82-ba5d-16d47cd7be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.638432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7bb8-e867-4b82-ba5d-16d47cd7be4e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.638728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7bb8-e867-4b82-ba5d-16d47cd7be4e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.639011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7bb8-e867-4b82-ba5d-16d47cd7be4e None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.639400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c2c84-e35f-437d-85fd-0daadddbb5a5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.640258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf7bb8-e867-4b82-ba5d-16d47cd7be4e None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.642290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf7bb8-e867-4b82-ba5d-16d47cd7be4e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.644002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 61/126] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.645584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf7bb8-e867-4b82-ba5d-16d47cd7be4e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.656784 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:47.773096 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c2c84-e35f-437d-85fd-0daadddbb5a5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.779084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf7bb8-e867-4b82-ba5d-16d47cd7be4e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.786818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:47.817113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042b17-8f65-4dce-b2be-7e56c9f72c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.818062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042b17-8f65-4dce-b2be-7e56c9f72c2d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.818567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042b17-8f65-4dce-b2be-7e56c9f72c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.818728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937140-e4f3-4fa9-b0a9-e42816a85640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.819149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042b17-8f65-4dce-b2be-7e56c9f72c2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.819699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937140-e4f3-4fa9-b0a9-e42816a85640 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.820281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937140-e4f3-4fa9-b0a9-e42816a85640 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.820654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937140-e4f3-4fa9-b0a9-e42816a85640 None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.821959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52937140-e4f3-4fa9-b0a9-e42816a85640 None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.823517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52937140-e4f3-4fa9-b0a9-e42816a85640 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.829566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 62/127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.829566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937140-e4f3-4fa9-b0a9-e42816a85640 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.837797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042b17-8f65-4dce-b2be-7e56c9f72c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-47042b17-8f65-4dce-b2be-7e56c9f72c2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:47.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:47.845819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:47.846819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:47.848969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 66/128] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:47.850515 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042b17-8f65-4dce-b2be-7e56c9f72c2d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:47.934912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:47.940104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937140-e4f3-4fa9-b0a9-e42816a85640 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.983235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091caa1-8338-4f18-bef4-064f75598f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:47.983987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091caa1-8338-4f18-bef4-064f75598f23 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:47.984345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091caa1-8338-4f18-bef4-064f75598f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:47.984591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042b17-8f65-4dce-b2be-7e56c9f72c2d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:47.984700 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091caa1-8338-4f18-bef4-064f75598f23 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:47.985951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091caa1-8338-4f18-bef4-064f75598f23 None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:47.988240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091caa1-8338-4f18-bef4-064f75598f23 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:47.989347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 63/129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:47.990295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091caa1-8338-4f18-bef4-064f75598f23 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:48.032704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23e0c-4459-4d7a-8334-79df6902dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:48.033726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23e0c-4459-4d7a-8334-79df6902dcb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.034186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23e0c-4459-4d7a-8334-79df6902dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.034647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23e0c-4459-4d7a-8334-79df6902dcb2 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/users/76a491a3cc6546888fbf514517cd658a/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.036845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b23e0c-4459-4d7a-8334-79df6902dcb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user_id=76a491a3cc6546888fbf514517cd658a, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:48.039254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b23e0c-4459-4d7a-8334-79df6902dcb2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:48.041822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:48.057845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 67/130] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:07:47 2022] PUT /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/users/76a491a3cc6546888fbf514517cd658a/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:07:48.058715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23e0c-4459-4d7a-8334-79df6902dcb2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:48.125805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091caa1-8338-4f18-bef4-064f75598f23 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:48.172518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1aa3-2d24-4456-af8e-88e238d1072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:48.173722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1aa3-2d24-4456-af8e-88e238d1072d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.173924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23e0c-4459-4d7a-8334-79df6902dcb2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:48.174413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1aa3-2d24-4456-af8e-88e238d1072d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.174946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1aa3-2d24-4456-af8e-88e238d1072d None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.176727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c1aa3-2d24-4456-af8e-88e238d1072d None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:48.178589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c1aa3-2d24-4456-af8e-88e238d1072d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:48.180720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 64/131] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:47 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:48.181812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1aa3-2d24-4456-af8e-88e238d1072d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:48.211047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:48.223203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5d4c6-b49d-44b4-a539-30b0ffe64296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:48.223610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d4c6-b49d-44b4-a539-30b0ffe64296 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.223942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d4c6-b49d-44b4-a539-30b0ffe64296 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.224316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d4c6-b49d-44b4-a539-30b0ffe64296 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.225149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d4c6-b49d-44b4-a539-30b0ffe64296 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:48.226386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d4c6-b49d-44b4-a539-30b0ffe64296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:48.227870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d4c6-b49d-44b4-a539-30b0ffe64296 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:48.238402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 68/132] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:48.239642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39612f-1818-41d5-9a67-f9e011d08cb6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.239955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39612f-1818-41d5-9a67-f9e011d08cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.241467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39612f-1818-41d5-9a67-f9e011d08cb6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.246731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 69/133] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:48.246731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39612f-1818-41d5-9a67-f9e011d08cb6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:48.319503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1aa3-2d24-4456-af8e-88e238d1072d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:48.336176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:48.368312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39612f-1818-41d5-9a67-f9e011d08cb6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:48.370105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6ad2-d7ae-469e-aba1-3ed9b6aada51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:48.371779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6ad2-d7ae-469e-aba1-3ed9b6aada51 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.372083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6ad2-d7ae-469e-aba1-3ed9b6aada51 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.372365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6ad2-d7ae-469e-aba1-3ed9b6aada51 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/users/4566f2276f01462e910e3412f7107cd6/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.374443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e6ad2-d7ae-469e-aba1-3ed9b6aada51 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user_id=4566f2276f01462e910e3412f7107cd6, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:48.375919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e6ad2-d7ae-469e-aba1-3ed9b6aada51 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:48.398634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 65/134] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:07:48 2022] PUT /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/users/4566f2276f01462e910e3412f7107cd6/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:07:48.400057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6ad2-d7ae-469e-aba1-3ed9b6aada51 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:48.454573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b55fea-133a-4d2a-8d0c-afac91bb7f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:48.455804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b55fea-133a-4d2a-8d0c-afac91bb7f19 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.456338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b55fea-133a-4d2a-8d0c-afac91bb7f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.456858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b55fea-133a-4d2a-8d0c-afac91bb7f19 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/users/4566f2276f01462e910e3412f7107cd6/roles/88a411c5f867401fb95db3c20cd8f8f1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.470503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b55fea-133a-4d2a-8d0c-afac91bb7f19 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user_id=4566f2276f01462e910e3412f7107cd6, role_id=88a411c5f867401fb95db3c20cd8f8f1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:48.472027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b55fea-133a-4d2a-8d0c-afac91bb7f19 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:48.508637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 70/135] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:07:48 2022] PUT /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/users/4566f2276f01462e910e3412f7107cd6/roles/88a411c5f867401fb95db3c20cd8f8f1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:07:48.509684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9a60-154b-46c0-9b09-ffff9260b719 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.510039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9a60-154b-46c0-9b09-ffff9260b719 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.510324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9a60-154b-46c0-9b09-ffff9260b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.541617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-64ef9a60-154b-46c0-9b09-ffff9260b719 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:48.542881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-64ef9a60-154b-46c0-9b09-ffff9260b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:48.552089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6ad2-d7ae-469e-aba1-3ed9b6aada51 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:48.602425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:48.627485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689fdb7-4815-418c-8149-30446eec8729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:48.628204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689fdb7-4815-418c-8149-30446eec8729 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.628472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689fdb7-4815-418c-8149-30446eec8729 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.628718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689fdb7-4815-418c-8149-30446eec8729 None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.630681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 71/136] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:48.632060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689fdb7-4815-418c-8149-30446eec8729 None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:48.633676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689fdb7-4815-418c-8149-30446eec8729 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:48.635410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 66/137] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:48 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:48.641727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef9a60-154b-46c0-9b09-ffff9260b719 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:48.764295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef9a60-154b-46c0-9b09-ffff9260b719 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:48.815437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208045fc-da1e-40d7-966b-6177c3ffbb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:48.816173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208045fc-da1e-40d7-966b-6177c3ffbb28 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:48.816462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208045fc-da1e-40d7-966b-6177c3ffbb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:48.816743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208045fc-da1e-40d7-966b-6177c3ffbb28 None admin] PATH_INFO: `/v3/projects/264b02e7c85f472ba781c71c018222e8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:48.818006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208045fc-da1e-40d7-966b-6177c3ffbb28 None admin] RBAC: Authorizing `identity:get_project(project_id=264b02e7c85f472ba781c71c018222e8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:48.820231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208045fc-da1e-40d7-966b-6177c3ffbb28 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:48.822212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 72/138] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:48 2022] GET /identity/v3/projects/264b02e7c85f472ba781c71c018222e8 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:48.830666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689fdb7-4815-418c-8149-30446eec8729 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:48.903363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:48.991095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689fdb7-4815-418c-8149-30446eec8729 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:49.016786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208045fc-da1e-40d7-966b-6177c3ffbb28 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:49.047768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08c4d-9c53-429b-af64-ae046ed9a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:49.048455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08c4d-9c53-429b-af64-ae046ed9a349 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:49.048745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08c4d-9c53-429b-af64-ae046ed9a349 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:49.049026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08c4d-9c53-429b-af64-ae046ed9a349 None admin] PATH_INFO: `/v3/projects/264b02e7c85f472ba781c71c018222e8/users/4566f2276f01462e910e3412f7107cd6/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:49.051061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d08c4d-9c53-429b-af64-ae046ed9a349 None admin] RBAC: Authorizing `identity:create_grant(project_id=264b02e7c85f472ba781c71c018222e8, user_id=4566f2276f01462e910e3412f7107cd6, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:49.052617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d08c4d-9c53-429b-af64-ae046ed9a349 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:49.072443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 67/139] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:07:48 2022] PUT /identity/v3/projects/264b02e7c85f472ba781c71c018222e8/users/4566f2276f01462e910e3412f7107cd6/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:07:49.093056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:49.167404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208045fc-da1e-40d7-966b-6177c3ffbb28 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:49.222634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78f836-cfe4-4ecd-acfb-1c6bbb3ea556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:49.223460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78f836-cfe4-4ecd-acfb-1c6bbb3ea556 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:49.223810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78f836-cfe4-4ecd-acfb-1c6bbb3ea556 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:49.224198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78f836-cfe4-4ecd-acfb-1c6bbb3ea556 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:49.225820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78f836-cfe4-4ecd-acfb-1c6bbb3ea556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:49.227387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78f836-cfe4-4ecd-acfb-1c6bbb3ea556 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:49.229182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 73/140] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:49.234680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08c4d-9c53-429b-af64-ae046ed9a349 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:49.386279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:49.390022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08c4d-9c53-429b-af64-ae046ed9a349 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:49.432631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36061f52-af17-48e5-baf3-eb96d39dca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:49.433176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36061f52-af17-48e5-baf3-eb96d39dca84 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:49.433464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36061f52-af17-48e5-baf3-eb96d39dca84 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:49.433776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36061f52-af17-48e5-baf3-eb96d39dca84 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:49.434475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36061f52-af17-48e5-baf3-eb96d39dca84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:49.435960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36061f52-af17-48e5-baf3-eb96d39dca84 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:49.465071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 68/141] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:07:49 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:07:50.715981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da53ae-6e11-40b5-8031-12d613582fa7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:50.716501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da53ae-6e11-40b5-8031-12d613582fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:50.716574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da53ae-6e11-40b5-8031-12d613582fa7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:50.717948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 74/142] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:50.724787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce9b5-78ab-4132-93fb-91cf252fe8c1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:50.725609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce9b5-78ab-4132-93fb-91cf252fe8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:50.725609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce9b5-78ab-4132-93fb-91cf252fe8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:50.755964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-379ce9b5-78ab-4132-93fb-91cf252fe8c1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:50.757387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-379ce9b5-78ab-4132-93fb-91cf252fe8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:50.758997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef9de-dea0-453c-a633-03d8d412c693 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:50.759281 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef9de-dea0-453c-a633-03d8d412c693 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:50.759553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef9de-dea0-453c-a633-03d8d412c693 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:50.761223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 75/143] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:07:50.767255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c697-73af-467a-82d4-825935044963 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:50.767744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c697-73af-467a-82d4-825935044963 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:50.768265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c697-73af-467a-82d4-825935044963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:50.803657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2d66c697-73af-467a-82d4-825935044963 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:50.809218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2d66c697-73af-467a-82d4-825935044963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:50.930157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 69/144] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:50.947334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 76/145] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:51.298529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce9b5-78ab-4132-93fb-91cf252fe8c1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:51.421003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:51.443138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce9b5-78ab-4132-93fb-91cf252fe8c1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:51.488847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b25315-bc45-481e-b53d-0dadf9329dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:51.489918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25315-bc45-481e-b53d-0dadf9329dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:51.490925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25315-bc45-481e-b53d-0dadf9329dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:51.491112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b25315-bc45-481e-b53d-0dadf9329dd9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:51.509892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b25315-bc45-481e-b53d-0dadf9329dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-64b25315-bc45-481e-b53d-0dadf9329dd9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:51.515217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:51.516118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:07:51.516860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:51.519323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 70/146] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:51.527958 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c697-73af-467a-82d4-825935044963 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:51.614024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:51.675675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c697-73af-467a-82d4-825935044963 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:51.690590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b25315-bc45-481e-b53d-0dadf9329dd9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:51.717177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:51.717897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:51.718116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:51.718395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:51.719857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:51.719857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:51.720818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:51.737575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 77/147] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:51.741653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:51.861632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404275d4-5bcd-40fe-a749-fe1a1fe48943 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:51.865415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b25315-bc45-481e-b53d-0dadf9329dd9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:51.869714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:51.905469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71717d80-986b-48f2-8101-e0340f92d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:51.906172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717d80-986b-48f2-8101-e0340f92d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:51.906442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717d80-986b-48f2-8101-e0340f92d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:51.906788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71717d80-986b-48f2-8101-e0340f92d5f0 None admin] PATH_INFO: `/v3/users/1ab8a20f37e644369f7d461fa6598805` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:51.908025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71717d80-986b-48f2-8101-e0340f92d5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab8a20f37e644369f7d461fa6598805)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:51.909549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71717d80-986b-48f2-8101-e0340f92d5f0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:51.911560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 78/148] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:51 2022] GET /identity/v3/users/1ab8a20f37e644369f7d461fa6598805 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:51.918025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71717d80-986b-48f2-8101-e0340f92d5f0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:51.933648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9f891-66b4-4d81-8aff-bb6870e4ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:51.933648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9f891-66b4-4d81-8aff-bb6870e4ac9d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:51.933648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9f891-66b4-4d81-8aff-bb6870e4ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:51.933648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9f891-66b4-4d81-8aff-bb6870e4ac9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:51.953566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9f891-66b4-4d81-8aff-bb6870e4ac9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fbd9f891-66b4-4d81-8aff-bb6870e4ac9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:51.957806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:51.958765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:51.960064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 71/149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:51.966167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9f891-66b4-4d81-8aff-bb6870e4ac9d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:51.974941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:52.058272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71717d80-986b-48f2-8101-e0340f92d5f0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:52.103645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b3f0e-1d7a-4c7b-bf35-c10fd503ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:52.104300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b3f0e-1d7a-4c7b-bf35-c10fd503ec33 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:52.104586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b3f0e-1d7a-4c7b-bf35-c10fd503ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:52.104865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b3f0e-1d7a-4c7b-bf35-c10fd503ec33 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:52.109238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b3f0e-1d7a-4c7b-bf35-c10fd503ec33 None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:52.111247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b3f0e-1d7a-4c7b-bf35-c10fd503ec33 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:52.112676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 79/150] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:51 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:52.120014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b3f0e-1d7a-4c7b-bf35-c10fd503ec33 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:52.168855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9f891-66b4-4d81-8aff-bb6870e4ac9d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:52.176544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:52.249029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a99a4-3147-4b29-95b1-a75b49eeb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:52.249614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a99a4-3147-4b29-95b1-a75b49eeb876 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:52.249904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a99a4-3147-4b29-95b1-a75b49eeb876 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:52.250181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a99a4-3147-4b29-95b1-a75b49eeb876 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:52.250883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a99a4-3147-4b29-95b1-a75b49eeb876 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:52.251192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a99a4-3147-4b29-95b1-a75b49eeb876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:52.252639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a99a4-3147-4b29-95b1-a75b49eeb876 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:52.263381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b3f0e-1d7a-4c7b-bf35-c10fd503ec33 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:52.267850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 72/151] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:52.268962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311527-d39b-448f-8baf-e11899dc03a4 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:52.269243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311527-d39b-448f-8baf-e11899dc03a4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:52.269521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311527-d39b-448f-8baf-e11899dc03a4 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:52.275237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 73/152] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:52.281564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42755-7dd9-4efe-bf9e-c11aef67d9d1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:52.281897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42755-7dd9-4efe-bf9e-c11aef67d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:52.282180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42755-7dd9-4efe-bf9e-c11aef67d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:52.318398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff5985-5ac6-4a4d-a5b1-46ea780ee6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:52.319606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff5985-5ac6-4a4d-a5b1-46ea780ee6f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:52.319963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff5985-5ac6-4a4d-a5b1-46ea780ee6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:52.320253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff5985-5ac6-4a4d-a5b1-46ea780ee6f2 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/users/1ab8a20f37e644369f7d461fa6598805/roles/42427d2d58f0468cb0d9d1d3e97617a7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:52.321155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6de42755-7dd9-4efe-bf9e-c11aef67d9d1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:52.322348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff5985-5ac6-4a4d-a5b1-46ea780ee6f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user_id=1ab8a20f37e644369f7d461fa6598805, role_id=42427d2d58f0468cb0d9d1d3e97617a7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:52.322704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6de42755-7dd9-4efe-bf9e-c11aef67d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:52.323816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff5985-5ac6-4a4d-a5b1-46ea780ee6f2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:52.346889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 80/153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:07:52 2022] PUT /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/users/1ab8a20f37e644369f7d461fa6598805/roles/42427d2d58f0468cb0d9d1d3e97617a7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:07:52.347491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff5985-5ac6-4a4d-a5b1-46ea780ee6f2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:52.450211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:52.468080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 74/154] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:52.539187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff5985-5ac6-4a4d-a5b1-46ea780ee6f2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:52.540840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:52.579405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84cf77-676e-4b4a-b9ca-e869d8ee83ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:52.580131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84cf77-676e-4b4a-b9ca-e869d8ee83ac None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:52.580445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84cf77-676e-4b4a-b9ca-e869d8ee83ac None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:52.580698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84cf77-676e-4b4a-b9ca-e869d8ee83ac None admin] PATH_INFO: `/v3/users/76a491a3cc6546888fbf514517cd658a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:52.586334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84cf77-676e-4b4a-b9ca-e869d8ee83ac None admin] RBAC: Authorizing `identity:get_user(user_id=76a491a3cc6546888fbf514517cd658a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:52.587846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84cf77-676e-4b4a-b9ca-e869d8ee83ac None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:52.589795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 81/155] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:52 2022] GET /identity/v3/users/76a491a3cc6546888fbf514517cd658a => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:52.595105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42755-7dd9-4efe-bf9e-c11aef67d9d1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:52.715440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42755-7dd9-4efe-bf9e-c11aef67d9d1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:52.756469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f111ce-5c72-451a-a94e-dd33b1d708ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:52.757111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f111ce-5c72-451a-a94e-dd33b1d708ef None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:52.757392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f111ce-5c72-451a-a94e-dd33b1d708ef None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:52.757694 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f111ce-5c72-451a-a94e-dd33b1d708ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:52.846583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:52.858013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f111ce-5c72-451a-a94e-dd33b1d708ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:52.859568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f111ce-5c72-451a-a94e-dd33b1d708ef None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:52.977408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 75/156] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:52.983141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84cf77-676e-4b4a-b9ca-e869d8ee83ac None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:53.096243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84cf77-676e-4b4a-b9ca-e869d8ee83ac None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:53.134169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f111ce-5c72-451a-a94e-dd33b1d708ef None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:53.153240 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee4e9e-9f0d-47d6-882c-0bf2dab3247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:53.154349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee4e9e-9f0d-47d6-882c-0bf2dab3247d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.154676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee4e9e-9f0d-47d6-882c-0bf2dab3247d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.155127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee4e9e-9f0d-47d6-882c-0bf2dab3247d None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.158334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee4e9e-9f0d-47d6-882c-0bf2dab3247d None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:53.159876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee4e9e-9f0d-47d6-882c-0bf2dab3247d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:53.165574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 82/157] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:52 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:53.168507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee4e9e-9f0d-47d6-882c-0bf2dab3247d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:53.264280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:53.348157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:53.362068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f111ce-5c72-451a-a94e-dd33b1d708ef None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:53.404265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee4e9e-9f0d-47d6-882c-0bf2dab3247d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:53.444464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a5d90-8dc7-47be-a2e2-0046757d11c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:53.445175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a5d90-8dc7-47be-a2e2-0046757d11c0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.445456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a5d90-8dc7-47be-a2e2-0046757d11c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.445755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a5d90-8dc7-47be-a2e2-0046757d11c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.471885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a5d90-8dc7-47be-a2e2-0046757d11c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4b7a5d90-8dc7-47be-a2e2-0046757d11c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:53.481896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:53.482809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 76/158] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:07:53.485025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d4ad7-48d2-4bcc-a838-86c8df27a93f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.486768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab120b1-50cf-4f85-bf64-3ecc16c5cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:53.486938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d4ad7-48d2-4bcc-a838-86c8df27a93f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.486938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d4ad7-48d2-4bcc-a838-86c8df27a93f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.487214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab120b1-50cf-4f85-bf64-3ecc16c5cde9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.487214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab120b1-50cf-4f85-bf64-3ecc16c5cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.487214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab120b1-50cf-4f85-bf64-3ecc16c5cde9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.487214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab120b1-50cf-4f85-bf64-3ecc16c5cde9 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user.id=76a491a3cc6546888fbf514517cd658a) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:53.487214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab120b1-50cf-4f85-bf64-3ecc16c5cde9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:53.487866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 77/159] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:53.493070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab120b1-50cf-4f85-bf64-3ecc16c5cde9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:53.494517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d4ad7-48d2-4bcc-a838-86c8df27a93f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:53.498632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 83/160] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:53 2022] GET /identity/v3/role_assignments?user.id=76a491a3cc6546888fbf514517cd658a&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:53.500025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b00210-6401-4bb6-b90f-0e47d06a4526 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.500309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b00210-6401-4bb6-b90f-0e47d06a4526 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.500579 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b00210-6401-4bb6-b90f-0e47d06a4526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.531949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a6b00210-6401-4bb6-b90f-0e47d06a4526 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:53.533299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a6b00210-6401-4bb6-b90f-0e47d06a4526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:53.691962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d4ad7-48d2-4bcc-a838-86c8df27a93f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:53.720199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 84/161] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:53.754505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423456d4-f6e9-4b2a-9de9-4109893a0ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:53.755161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423456d4-f6e9-4b2a-9de9-4109893a0ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.755441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423456d4-f6e9-4b2a-9de9-4109893a0ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.756344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423456d4-f6e9-4b2a-9de9-4109893a0ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.757331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423456d4-f6e9-4b2a-9de9-4109893a0ed0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:53.757704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423456d4-f6e9-4b2a-9de9-4109893a0ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:53.759175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423456d4-f6e9-4b2a-9de9-4109893a0ed0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:53.773927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 78/162] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:53.780246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b00210-6401-4bb6-b90f-0e47d06a4526 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:53.823875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:53.910588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b00210-6401-4bb6-b90f-0e47d06a4526 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:53.945698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142c18-0147-4cfa-863e-1a0d8c7dc979 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.946003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142c18-0147-4cfa-863e-1a0d8c7dc979 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.946162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142c18-0147-4cfa-863e-1a0d8c7dc979 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.947519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 79/163] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:07:53.954259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd907f8-d3c7-4f35-961d-4e19acefd3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:53.954891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41d22-f05d-49b1-aab3-7a070aa40bcf None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.955180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41d22-f05d-49b1-aab3-7a070aa40bcf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.955461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41d22-f05d-49b1-aab3-7a070aa40bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.958829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd907f8-d3c7-4f35-961d-4e19acefd3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:53.959222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd907f8-d3c7-4f35-961d-4e19acefd3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:53.959507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd907f8-d3c7-4f35-961d-4e19acefd3a1 None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:53.961012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd907f8-d3c7-4f35-961d-4e19acefd3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:53.962561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd907f8-d3c7-4f35-961d-4e19acefd3a1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:53.964672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 85/164] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:53 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:53.970212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd907f8-d3c7-4f35-961d-4e19acefd3a1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:53.992230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4db41d22-f05d-49b1-aab3-7a070aa40bcf None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:53.993792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4db41d22-f05d-49b1-aab3-7a070aa40bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:54.018582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:54.107496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 80/165] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:07:54.168886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:54.172849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd907f8-d3c7-4f35-961d-4e19acefd3a1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:54.220048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea716-4480-4d99-bf32-136b565c49e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:54.220586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea716-4480-4d99-bf32-136b565c49e7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:54.220908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea716-4480-4d99-bf32-136b565c49e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:54.221187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea716-4480-4d99-bf32-136b565c49e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:54.304030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41d22-f05d-49b1-aab3-7a070aa40bcf None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:54.307483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea716-4480-4d99-bf32-136b565c49e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:54.308955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea716-4480-4d99-bf32-136b565c49e7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:54.509257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41d22-f05d-49b1-aab3-7a070aa40bcf None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:54.522016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:54.528223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 86/166] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:54.534195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea716-4480-4d99-bf32-136b565c49e7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:54.568729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2eb0-01f9-4df8-9582-4af13634a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:54.569844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2eb0-01f9-4df8-9582-4af13634a787 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:54.570297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2eb0-01f9-4df8-9582-4af13634a787 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:54.570780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2eb0-01f9-4df8-9582-4af13634a787 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:54.595581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a2eb0-01f9-4df8-9582-4af13634a787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-9a4a2eb0-01f9-4df8-9582-4af13634a787 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:54.602413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:54.603378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:07:54.604295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:54.607010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 81/167] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:07:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:07:54.626845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2eb0-01f9-4df8-9582-4af13634a787 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:54.646369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:54.752803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea716-4480-4d99-bf32-136b565c49e7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:54.765645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2eb0-01f9-4df8-9582-4af13634a787 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:54.798345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4cb1c-538c-4acf-94a0-e6aec5483ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:54.799009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4cb1c-538c-4acf-94a0-e6aec5483ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:54.799296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4cb1c-538c-4acf-94a0-e6aec5483ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:54.799580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4cb1c-538c-4acf-94a0-e6aec5483ab9 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:54.806480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4cb1c-538c-4acf-94a0-e6aec5483ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:54.808020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4cb1c-538c-4acf-94a0-e6aec5483ab9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:54.809161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:54.809800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:54.810051 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 87/168] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:54 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:54.810154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:54.810336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:54.810910 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4cb1c-538c-4acf-94a0-e6aec5483ab9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:54.811013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:54.811296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:54.812680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:54.822059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 82/169] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:07:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:54.846376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:54.899864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:54.937823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4cb1c-538c-4acf-94a0-e6aec5483ab9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:54.985827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fdfab-e96c-4351-a237-a6d141d19cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:54.986499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdfab-e96c-4351-a237-a6d141d19cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:54.986785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdfab-e96c-4351-a237-a6d141d19cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:54.987061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdfab-e96c-4351-a237-a6d141d19cd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.011529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fdfab-e96c-4351-a237-a6d141d19cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:55.012446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-860fdfab-e96c-4351-a237-a6d141d19cd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:55.019276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:55.020249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:07:55.021120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:07:55.023548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 88/170] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:55.025646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fdfab-e96c-4351-a237-a6d141d19cd9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:55.091451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875ec7-59c5-43f5-b93d-697af371d691 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:55.169246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9a748-62c4-433d-accc-e235af9e2054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:55.169934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a748-62c4-433d-accc-e235af9e2054 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.170213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a748-62c4-433d-accc-e235af9e2054 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.170482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a748-62c4-433d-accc-e235af9e2054 None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.174118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9a748-62c4-433d-accc-e235af9e2054 None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:55.175646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9a748-62c4-433d-accc-e235af9e2054 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:55.188663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 83/171] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:54 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:07:55.189684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9a748-62c4-433d-accc-e235af9e2054 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:55.193908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fdfab-e96c-4351-a237-a6d141d19cd9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:55.234494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:55.263279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae3232-cf1e-42ec-af3f-b8efd8159cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:55.263912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3232-cf1e-42ec-af3f-b8efd8159cac None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.264197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3232-cf1e-42ec-af3f-b8efd8159cac None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.264473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3232-cf1e-42ec-af3f-b8efd8159cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.265217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae3232-cf1e-42ec-af3f-b8efd8159cac None admin] RBAC: Adding query filter params (role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user.id=4566f2276f01462e910e3412f7107cd6) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:55.265524 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae3232-cf1e-42ec-af3f-b8efd8159cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:55.267046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae3232-cf1e-42ec-af3f-b8efd8159cac None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:55.274396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 89/172] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:55 2022] GET /identity/v3/role_assignments?user.id=4566f2276f01462e910e3412f7107cd6&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:55.275388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e578-6f52-448f-b821-11cecbd39495 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.275669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e578-6f52-448f-b821-11cecbd39495 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.275998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e578-6f52-448f-b821-11cecbd39495 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.277487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 90/173] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:55.278220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8e578-6f52-448f-b821-11cecbd39495 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:55.331876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9a748-62c4-433d-accc-e235af9e2054 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:55.373393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58dd80-3a1f-4465-9ac1-78ec20401933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:55.374149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58dd80-3a1f-4465-9ac1-78ec20401933 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.374673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58dd80-3a1f-4465-9ac1-78ec20401933 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.374958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58dd80-3a1f-4465-9ac1-78ec20401933 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.375691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58dd80-3a1f-4465-9ac1-78ec20401933 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:55.376022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58dd80-3a1f-4465-9ac1-78ec20401933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:55.377515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58dd80-3a1f-4465-9ac1-78ec20401933 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:55.386097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:55.390508 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 84/174] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:55.395795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff459f4-e77c-4922-9c91-ba4f552de2c0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.396085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff459f4-e77c-4922-9c91-ba4f552de2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.396991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff459f4-e77c-4922-9c91-ba4f552de2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.427489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6ff459f4-e77c-4922-9c91-ba4f552de2c0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:55.428985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6ff459f4-e77c-4922-9c91-ba4f552de2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:55.523822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8e578-6f52-448f-b821-11cecbd39495 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:55.542299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 85/175] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:55.543872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712be69-bc75-4e54-b95d-25658a566590 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.544321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712be69-bc75-4e54-b95d-25658a566590 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.544738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712be69-bc75-4e54-b95d-25658a566590 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.546227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 86/176] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:55.547660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712be69-bc75-4e54-b95d-25658a566590 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:55.575230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ee99b-0e87-4f48-ada5-e7d872a65040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:55.575851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee99b-0e87-4f48-ada5-e7d872a65040 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.576194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee99b-0e87-4f48-ada5-e7d872a65040 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.576406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee99b-0e87-4f48-ada5-e7d872a65040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.657598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:55.671716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee99b-0e87-4f48-ada5-e7d872a65040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:55.673280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee99b-0e87-4f48-ada5-e7d872a65040 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:55.714588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712be69-bc75-4e54-b95d-25658a566590 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:55.762238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:55.773068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803be9-7ccb-482b-89eb-951297079bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:55.774186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803be9-7ccb-482b-89eb-951297079bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.774679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803be9-7ccb-482b-89eb-951297079bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.775156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803be9-7ccb-482b-89eb-951297079bf2 None admin] PATH_INFO: `/v3/users/4566f2276f01462e910e3412f7107cd6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.777867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803be9-7ccb-482b-89eb-951297079bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=4566f2276f01462e910e3412f7107cd6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:55.780731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803be9-7ccb-482b-89eb-951297079bf2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:55.783726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 87/177] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:55 2022] GET /identity/v3/users/4566f2276f01462e910e3412f7107cd6 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:55.784990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a5fc-b136-46c3-870c-42f3578a884a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.785333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a5fc-b136-46c3-870c-42f3578a884a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.785639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a5fc-b136-46c3-870c-42f3578a884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.819161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9df6a5fc-b136-46c3-870c-42f3578a884a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:55.820482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9df6a5fc-b136-46c3-870c-42f3578a884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:55.829248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 91/178] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:55.830899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d0eb-f789-4af6-8a33-893bb9297afa None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:55.831931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d0eb-f789-4af6-8a33-893bb9297afa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:55.832417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d0eb-f789-4af6-8a33-893bb9297afa None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:55.835046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 92/179] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:55.836031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676d0eb-f789-4af6-8a33-893bb9297afa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:55.905112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 88/180] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:55.906393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a5fc-b136-46c3-870c-42f3578a884a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:55.961668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:55.977244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676d0eb-f789-4af6-8a33-893bb9297afa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.015125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a5fc-b136-46c3-870c-42f3578a884a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.021180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab04ea-4e37-496b-8dfe-41115fc21149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.022642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab04ea-4e37-496b-8dfe-41115fc21149 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.023124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab04ea-4e37-496b-8dfe-41115fc21149 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.024070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab04ea-4e37-496b-8dfe-41115fc21149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.054291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:56.067216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313caf0-ec96-4587-a203-b610bc515d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.069845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313caf0-ec96-4587-a203-b610bc515d17 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.070347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313caf0-ec96-4587-a203-b610bc515d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.070814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313caf0-ec96-4587-a203-b610bc515d17 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.073440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313caf0-ec96-4587-a203-b610bc515d17 None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:56.075183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313caf0-ec96-4587-a203-b610bc515d17 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:56.077265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 89/181] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:55 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:56.079266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d6e6-0558-4166-8e76-05e81980d5c2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.080273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d6e6-0558-4166-8e76-05e81980d5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.080750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d6e6-0558-4166-8e76-05e81980d5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.105878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3538d6e6-0558-4166-8e76-05e81980d5c2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:56.108145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3538d6e6-0558-4166-8e76-05e81980d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:56.124558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab04ea-4e37-496b-8dfe-41115fc21149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:56.128626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab04ea-4e37-496b-8dfe-41115fc21149 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:56.209832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 90/182] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:56.218622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538d6e6-0558-4166-8e76-05e81980d5c2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.243566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:56.257284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 93/183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:56.258589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab04ea-4e37-496b-8dfe-41115fc21149 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.332818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538d6e6-0558-4166-8e76-05e81980d5c2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.359874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:56.369638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7770c12-fbec-4150-8e30-49d53500e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.370274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7770c12-fbec-4150-8e30-49d53500e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.370551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7770c12-fbec-4150-8e30-49d53500e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.370844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7770c12-fbec-4150-8e30-49d53500e8d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.370942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab04ea-4e37-496b-8dfe-41115fc21149 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.382868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7770c12-fbec-4150-8e30-49d53500e8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f7770c12-fbec-4150-8e30-49d53500e8d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:56.387795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:56.388689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:56.389480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 91/184] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:07:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:56.390609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7770c12-fbec-4150-8e30-49d53500e8d8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.415710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.416326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.416609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.416884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.417649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] RBAC: Adding query filter params (role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user.id=4566f2276f01462e910e3412f7107cd6) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:56.417961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:56.419421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:56.429602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 94/185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:56 2022] GET /identity/v3/role_assignments?user.id=4566f2276f01462e910e3412f7107cd6&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:56.429602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.496373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:56.533907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7770c12-fbec-4150-8e30-49d53500e8d8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.551288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e85861-314b-4ec5-bb57-2b306934e55a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.573491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4294af-0944-4c41-9c5a-37c54698421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.574185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4294af-0944-4c41-9c5a-37c54698421e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.574471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4294af-0944-4c41-9c5a-37c54698421e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.574744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4294af-0944-4c41-9c5a-37c54698421e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.587869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4294af-0944-4c41-9c5a-37c54698421e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6d4294af-0944-4c41-9c5a-37c54698421e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:56.592835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:56.594032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:07:56.595047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:56.598928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 92/186] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:07:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:56.600210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca00c2-2bf2-46b0-8522-f05b2cbf905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.600596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34d33-aa1e-4b10-b346-ee1e6af3b784 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.600883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34d33-aa1e-4b10-b346-ee1e6af3b784 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.601160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34d33-aa1e-4b10-b346-ee1e6af3b784 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.601689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca00c2-2bf2-46b0-8522-f05b2cbf905f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.602149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca00c2-2bf2-46b0-8522-f05b2cbf905f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.602590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca00c2-2bf2-46b0-8522-f05b2cbf905f None admin] PATH_INFO: `/v3/projects/264b02e7c85f472ba781c71c018222e8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.603150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 93/187] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:07:56.603913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34d33-aa1e-4b10-b346-ee1e6af3b784 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.604402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca00c2-2bf2-46b0-8522-f05b2cbf905f None admin] RBAC: Authorizing `identity:get_project(project_id=264b02e7c85f472ba781c71c018222e8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:56.606168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca00c2-2bf2-46b0-8522-f05b2cbf905f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:56.608030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 95/188] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:56 2022] GET /identity/v3/projects/264b02e7c85f472ba781c71c018222e8 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:56.608986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca00c2-2bf2-46b0-8522-f05b2cbf905f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.671687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:56.729391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca00c2-2bf2-46b0-8522-f05b2cbf905f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.735505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34d33-aa1e-4b10-b346-ee1e6af3b784 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.753035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:56.764857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44899-a48e-4418-af21-2d4ad45522eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.765498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44899-a48e-4418-af21-2d4ad45522eb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.765828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44899-a48e-4418-af21-2d4ad45522eb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.766109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44899-a48e-4418-af21-2d4ad45522eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.767265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b44899-a48e-4418-af21-2d4ad45522eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:56.768715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b44899-a48e-4418-af21-2d4ad45522eb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:56.770340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 96/189] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:07:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:56.770439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf72dc-69aa-4727-8334-b7b171635c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.771026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf72dc-69aa-4727-8334-b7b171635c31 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.771356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf72dc-69aa-4727-8334-b7b171635c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.771631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf72dc-69aa-4727-8334-b7b171635c31 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.772302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf72dc-69aa-4727-8334-b7b171635c31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:56.772599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf72dc-69aa-4727-8334-b7b171635c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:56.774016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf72dc-69aa-4727-8334-b7b171635c31 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:56.774424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44899-a48e-4418-af21-2d4ad45522eb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.782611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 94/190] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:56.787485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c27f0-a4e0-45f4-a867-2a686f875ca8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.787485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c27f0-a4e0-45f4-a867-2a686f875ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.787485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c27f0-a4e0-45f4-a867-2a686f875ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.803040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e12c27f0-a4e0-45f4-a867-2a686f875ca8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:07:56.804647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e12c27f0-a4e0-45f4-a867-2a686f875ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:07:56.872874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 95/191] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:07:56.874086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c27f0-a4e0-45f4-a867-2a686f875ca8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.878204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44899-a48e-4418-af21-2d4ad45522eb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:56.916891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:56.917512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:56.917827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:56.918109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:56.918795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:56.919102 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:56.920480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:56.927271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:56.930366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 97/192] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:07:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:56.931348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:56.990449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:57.000687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c27f0-a4e0-45f4-a867-2a686f875ca8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:57.043281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:57.043921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5cc76-18f4-46e5-a835-33f88f8d988c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:57.044043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:57.044276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:57.044433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:57.045169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] RBAC: Adding query filter params (role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=264b02e7c85f472ba781c71c018222e8, user.id=4566f2276f01462e910e3412f7107cd6) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:57.045506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:57.046987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:57.054011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 96/193] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:56 2022] GET /identity/v3/role_assignments?user.id=4566f2276f01462e910e3412f7107cd6&scope.project.id=264b02e7c85f472ba781c71c018222e8&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:57.054949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:57.098581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4619f-09d7-460c-ad88-3feb2322da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:57.100085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4619f-09d7-460c-ad88-3feb2322da1c None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:57.100378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4619f-09d7-460c-ad88-3feb2322da1c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:57.100657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4619f-09d7-460c-ad88-3feb2322da1c None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:57.102327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4619f-09d7-460c-ad88-3feb2322da1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:57.103870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4619f-09d7-460c-ad88-3feb2322da1c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:57.138340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 98/194] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:07:56 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:07:57.139297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4619f-09d7-460c-ad88-3feb2322da1c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:57.223923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b122ba-eb77-4443-9347-268bf5ae2593 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:57.227628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:57.268290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0e6ba-578a-40bd-a0f0-44790aad1de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:57.269042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e6ba-578a-40bd-a0f0-44790aad1de4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:57.269486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e6ba-578a-40bd-a0f0-44790aad1de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:57.269742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e6ba-578a-40bd-a0f0-44790aad1de4 None admin] PATH_INFO: `/v3/users/06c364d66c864209b6627ae06f697f32` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:57.278811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4619f-09d7-460c-ad88-3feb2322da1c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:57.289723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0e6ba-578a-40bd-a0f0-44790aad1de4 None admin] RBAC: Authorizing `identity:get_user(user_id=06c364d66c864209b6627ae06f697f32)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:57.291133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0e6ba-578a-40bd-a0f0-44790aad1de4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:57.293113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 97/195] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:57 2022] GET /identity/v3/users/06c364d66c864209b6627ae06f697f32 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:57.298882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0e6ba-578a-40bd-a0f0-44790aad1de4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:57.300534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:57.331144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077138-7595-45cd-bc0e-76a74728ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:57.331859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077138-7595-45cd-bc0e-76a74728ef1a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:57.332149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077138-7595-45cd-bc0e-76a74728ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:57.332437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077138-7595-45cd-bc0e-76a74728ef1a None admin] PATH_INFO: `/v3/users/06c364d66c864209b6627ae06f697f32` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:57.334394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39077138-7595-45cd-bc0e-76a74728ef1a None admin] RBAC: Authorizing `identity:get_user(user_id=06c364d66c864209b6627ae06f697f32)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:57.336624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39077138-7595-45cd-bc0e-76a74728ef1a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:57.338789 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 99/196] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:57 2022] GET /identity/v3/users/06c364d66c864209b6627ae06f697f32 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:57.339303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077138-7595-45cd-bc0e-76a74728ef1a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:57.442293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0e6ba-578a-40bd-a0f0-44790aad1de4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:57.491238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077138-7595-45cd-bc0e-76a74728ef1a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:57.495027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e931941-8f60-45c6-92ed-a0c46a76f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:57.496117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931941-8f60-45c6-92ed-a0c46a76f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:57.496611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931941-8f60-45c6-92ed-a0c46a76f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:57.497063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931941-8f60-45c6-92ed-a0c46a76f6d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:57.510550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e931941-8f60-45c6-92ed-a0c46a76f6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3e931941-8f60-45c6-92ed-a0c46a76f6d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:07:57.520343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:07:57.522018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:07:57.522885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:07:57.523562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 98/197] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:07:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:07:57.524649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e931941-8f60-45c6-92ed-a0c46a76f6d0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:57.536623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bda2b2-8da8-4470-9ab8-d2ef6c77beab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:57.538205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bda2b2-8da8-4470-9ab8-d2ef6c77beab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:57.538666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bda2b2-8da8-4470-9ab8-d2ef6c77beab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:57.539135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bda2b2-8da8-4470-9ab8-d2ef6c77beab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:57.560070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:57.599099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:57.633884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bda2b2-8da8-4470-9ab8-d2ef6c77beab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:57.635917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bda2b2-8da8-4470-9ab8-d2ef6c77beab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:57.664441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e931941-8f60-45c6-92ed-a0c46a76f6d0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:57.710147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c77a-3467-4988-b43e-bbb050f4994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:57.711212 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c77a-3467-4988-b43e-bbb050f4994f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:57.711491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c77a-3467-4988-b43e-bbb050f4994f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:57.712047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c77a-3467-4988-b43e-bbb050f4994f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:57.774191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 100/198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:57.776046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bda2b2-8da8-4470-9ab8-d2ef6c77beab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:57.817493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c77a-3467-4988-b43e-bbb050f4994f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:57.820437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c77a-3467-4988-b43e-bbb050f4994f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:57.851136 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:57.887728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:57.922087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bda2b2-8da8-4470-9ab8-d2ef6c77beab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:57.956666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 99/199] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:57.957549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c77a-3467-4988-b43e-bbb050f4994f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:57.968133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:57.969578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:57.970085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:57.971052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:57.972461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:57.973002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:57.975056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:57.987357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 101/200] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:07:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:57.988779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:58.080067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c77a-3467-4988-b43e-bbb050f4994f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:58.113382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:58.134502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd2bf-f185-44db-b435-b8b4b3244fbe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:58.142785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c1f02-dfcf-4c4f-bcfa-820f0a1cd2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:58.143705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c1f02-dfcf-4c4f-bcfa-820f0a1cd2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:58.144648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c1f02-dfcf-4c4f-bcfa-820f0a1cd2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:58.145122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c1f02-dfcf-4c4f-bcfa-820f0a1cd2a1 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:58.147725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c1f02-dfcf-4c4f-bcfa-820f0a1cd2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:58.150468 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c1f02-dfcf-4c4f-bcfa-820f0a1cd2a1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:58.158220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 100/201] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:57 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:58.159367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c1f02-dfcf-4c4f-bcfa-820f0a1cd2a1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:58.174494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e7d68-3ea1-489f-b7a1-44d616eae184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:58.175160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7d68-3ea1-489f-b7a1-44d616eae184 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:58.175457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7d68-3ea1-489f-b7a1-44d616eae184 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:58.175714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7d68-3ea1-489f-b7a1-44d616eae184 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:58.176934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e7d68-3ea1-489f-b7a1-44d616eae184 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:58.179095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e7d68-3ea1-489f-b7a1-44d616eae184 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:58.180713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 102/202] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:57 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:58.181304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e7d68-3ea1-489f-b7a1-44d616eae184 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:58.195935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:58.272522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c1f02-dfcf-4c4f-bcfa-820f0a1cd2a1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:58.309436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e7d68-3ea1-489f-b7a1-44d616eae184 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:58.313380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716fce4-dcf1-4dd4-b97f-43400f0d627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:58.314381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716fce4-dcf1-4dd4-b97f-43400f0d627d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:58.314852 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716fce4-dcf1-4dd4-b97f-43400f0d627d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:58.315335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716fce4-dcf1-4dd4-b97f-43400f0d627d None admin] PATH_INFO: `/v3/users/1ab8a20f37e644369f7d461fa6598805` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:58.316684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716fce4-dcf1-4dd4-b97f-43400f0d627d None admin] RBAC: Authorizing `identity:get_user(user_id=1ab8a20f37e644369f7d461fa6598805)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:58.319193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716fce4-dcf1-4dd4-b97f-43400f0d627d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:58.321172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 101/203] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:07:58 2022] GET /identity/v3/users/1ab8a20f37e644369f7d461fa6598805 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:58.322202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716fce4-dcf1-4dd4-b97f-43400f0d627d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:58.356289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:58.357013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:58.357308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:58.357623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:58.358428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12e668dc7f0d447dbd96817dbaa612de, user.id=06c364d66c864209b6627ae06f697f32) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:58.358744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:58.360232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:58.367123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 103/204] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:58 2022] GET /identity/v3/role_assignments?user.id=06c364d66c864209b6627ae06f697f32&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:58.368636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:58.403942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:58.468189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:58.500550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716fce4-dcf1-4dd4-b97f-43400f0d627d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:58.507207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfcd0-4a29-464a-9cf1-5f5a4d236307 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:58.549101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbe03d-1761-475a-a038-6b0193d102e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:58.550249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbe03d-1761-475a-a038-6b0193d102e3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:58.550757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbe03d-1761-475a-a038-6b0193d102e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:58.551322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbe03d-1761-475a-a038-6b0193d102e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:58.578384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:58.579482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:58.579482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:58.579669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:58.580334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] RBAC: Adding query filter params (role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=12e668dc7f0d447dbd96817dbaa612de, user.id=06c364d66c864209b6627ae06f697f32) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:58.580673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:58.583773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:58.589985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 102/205] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:58 2022] GET /identity/v3/role_assignments?user.id=06c364d66c864209b6627ae06f697f32&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:58.640481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbe03d-1761-475a-a038-6b0193d102e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:58.642760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbe03d-1761-475a-a038-6b0193d102e3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:58.732127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:58.770544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 104/206] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:07:58.778929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:58.921702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2661dd0-6e70-4a7b-8db7-2b61692f68b3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:58.944204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:07:58.961457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530c7e8-b3ea-4a26-9912-6e1d9f282aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:58.962181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c7e8-b3ea-4a26-9912-6e1d9f282aed None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:58.962540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c7e8-b3ea-4a26-9912-6e1d9f282aed None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:58.962823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c7e8-b3ea-4a26-9912-6e1d9f282aed None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:58.964122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530c7e8-b3ea-4a26-9912-6e1d9f282aed None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:58.965820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530c7e8-b3ea-4a26-9912-6e1d9f282aed None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:58.971912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 103/207] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:07:58 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:07:58.974384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbe03d-1761-475a-a038-6b0193d102e3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:07:59.111447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbe03d-1761-475a-a038-6b0193d102e3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:07:59.161688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfa281-031a-44e9-9a9b-21ecc4b7144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:07:59.162900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa281-031a-44e9-9a9b-21ecc4b7144b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:07:59.163185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa281-031a-44e9-9a9b-21ecc4b7144b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:07:59.163467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa281-031a-44e9-9a9b-21ecc4b7144b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:07:59.164279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa281-031a-44e9-9a9b-21ecc4b7144b None admin] RBAC: Adding query filter params (role.id=42427d2d58f0468cb0d9d1d3e97617a7, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, user.id=1ab8a20f37e644369f7d461fa6598805) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:07:59.164599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa281-031a-44e9-9a9b-21ecc4b7144b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:07:59.166697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa281-031a-44e9-9a9b-21ecc4b7144b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:07:59.173634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 105/208] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:07:58 2022] GET /identity/v3/role_assignments?user.id=1ab8a20f37e644369f7d461fa6598805&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=42427d2d58f0468cb0d9d1d3e97617a7 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:00.005300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ee65-f5cf-478d-be35-e6f15adb2d99 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:00.006363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ee65-f5cf-478d-be35-e6f15adb2d99 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:00.006436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ee65-f5cf-478d-be35-e6f15adb2d99 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:00.007863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 104/209] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:00.012921 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89000ac-2c87-46ab-9171-b9196057fc19 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:00.013193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89000ac-2c87-46ab-9171-b9196057fc19 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:00.013466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89000ac-2c87-46ab-9171-b9196057fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:00.017215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33ef18-7cac-45d0-8f7d-1126f8d117f5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:00.017649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33ef18-7cac-45d0-8f7d-1126f8d117f5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:00.017842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33ef18-7cac-45d0-8f7d-1126f8d117f5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:00.019562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 106/210] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:00.027606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da96b5-0894-4cf0-ba1e-e0834f0a42c8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:00.027902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da96b5-0894-4cf0-ba1e-e0834f0a42c8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:00.028157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da96b5-0894-4cf0-ba1e-e0834f0a42c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:00.046744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f89000ac-2c87-46ab-9171-b9196057fc19 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:00.048299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f89000ac-2c87-46ab-9171-b9196057fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:00.053175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-98da96b5-0894-4cf0-ba1e-e0834f0a42c8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:00.054583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98da96b5-0894-4cf0-ba1e-e0834f0a42c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:00.092974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:00.148079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 105/211] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:00.176842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 107/212] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:00.452497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89000ac-2c87-46ab-9171-b9196057fc19 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:00.470184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da96b5-0894-4cf0-ba1e-e0834f0a42c8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:00.584613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89000ac-2c87-46ab-9171-b9196057fc19 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:00.608260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da96b5-0894-4cf0-ba1e-e0834f0a42c8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:00.609194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:00.643648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924dcf-0626-4ece-885d-b2cc4a7a5bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:00.644915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924dcf-0626-4ece-885d-b2cc4a7a5bee None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:00.645658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924dcf-0626-4ece-885d-b2cc4a7a5bee None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:00.646138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924dcf-0626-4ece-885d-b2cc4a7a5bee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:00.650019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10924dcf-0626-4ece-885d-b2cc4a7a5bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:00.653240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10924dcf-0626-4ece-885d-b2cc4a7a5bee None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:00.656176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 106/213] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:00.662329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f69ddc-0e6f-402b-b10e-e8515f3a8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:00.663141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924dcf-0626-4ece-885d-b2cc4a7a5bee None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:00.663294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69ddc-0e6f-402b-b10e-e8515f3a8f18 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:00.663532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69ddc-0e6f-402b-b10e-e8515f3a8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:00.663940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69ddc-0e6f-402b-b10e-e8515f3a8f18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:00.680206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f69ddc-0e6f-402b-b10e-e8515f3a8f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d2f69ddc-0e6f-402b-b10e-e8515f3a8f18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:00.686616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:00.689390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:00.691043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 108/214] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:00.697473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f69ddc-0e6f-402b-b10e-e8515f3a8f18 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:00.731534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:00.810629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924dcf-0626-4ece-885d-b2cc4a7a5bee None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:00.836642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f69ddc-0e6f-402b-b10e-e8515f3a8f18 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:00.862444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefe3ab-0179-4d1a-adbb-1fb2eb21747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:00.863313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefe3ab-0179-4d1a-adbb-1fb2eb21747a None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:00.863838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefe3ab-0179-4d1a-adbb-1fb2eb21747a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:00.864341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefe3ab-0179-4d1a-adbb-1fb2eb21747a None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:00.865439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefe3ab-0179-4d1a-adbb-1fb2eb21747a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:00.868060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefe3ab-0179-4d1a-adbb-1fb2eb21747a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:00.892486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:00.893273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:00.893717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:00.894002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:00.894802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:00.895118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:00.897311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:00.898526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 107/215] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:08:00 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:00.914260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 109/216] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:00.920636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefe3ab-0179-4d1a-adbb-1fb2eb21747a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:00.981885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:01.066504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefe3ab-0179-4d1a-adbb-1fb2eb21747a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:01.109858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9b00-a743-488c-af25-e3a14437861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:01.110684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9b00-a743-488c-af25-e3a14437861b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.110970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9b00-a743-488c-af25-e3a14437861b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.111244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9b00-a743-488c-af25-e3a14437861b None admin] PATH_INFO: `/v3/users/68b954d63be14294ae419778045e8037` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.132601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc9b00-a743-488c-af25-e3a14437861b None admin] RBAC: Authorizing `identity:get_user(user_id=68b954d63be14294ae419778045e8037)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:01.132601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc9b00-a743-488c-af25-e3a14437861b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:01.133936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 108/217] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:00 2022] GET /identity/v3/users/68b954d63be14294ae419778045e8037 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:01.139626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:01.145906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19697-8d96-4d26-8bcb-72db85b85e94 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.147024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19697-8d96-4d26-8bcb-72db85b85e94 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.147506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19697-8d96-4d26-8bcb-72db85b85e94 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.149143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 109/218] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:01.155896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6f98-9d78-44ed-8eae-16a1684cef58 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.156208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6f98-9d78-44ed-8eae-16a1684cef58 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.156452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6f98-9d78-44ed-8eae-16a1684cef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.178461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-11bf6f98-9d78-44ed-8eae-16a1684cef58 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:01.180243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-11bf6f98-9d78-44ed-8eae-16a1684cef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:01.268824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:01.269405 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 110/219] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:01.289024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5d00b-2706-465c-9f2b-c4a9af2ff074 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:01.326104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71581622-a10e-4316-af2e-56121e845b0e None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.326520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71581622-a10e-4316-af2e-56121e845b0e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.326879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71581622-a10e-4316-af2e-56121e845b0e None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.329295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 111/220] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:08:01.336118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051129-a231-43b3-9e50-a007fc6feec7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.336413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051129-a231-43b3-9e50-a007fc6feec7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.336685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051129-a231-43b3-9e50-a007fc6feec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.346968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f134b-f562-4d0f-831e-b0d226577eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:01.347600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f134b-f562-4d0f-831e-b0d226577eaa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.347888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f134b-f562-4d0f-831e-b0d226577eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.348168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f134b-f562-4d0f-831e-b0d226577eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.362575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cb051129-a231-43b3-9e50-a007fc6feec7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:01.364205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cb051129-a231-43b3-9e50-a007fc6feec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:01.404954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:01.456144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f134b-f562-4d0f-831e-b0d226577eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:01.457667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f134b-f562-4d0f-831e-b0d226577eaa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:01.476143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 112/221] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:01.560960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:01.576115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 110/222] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:01.582735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb051129-a231-43b3-9e50-a007fc6feec7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:01.598224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f134b-f562-4d0f-831e-b0d226577eaa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:01.730836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f134b-f562-4d0f-831e-b0d226577eaa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:01.749004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb051129-a231-43b3-9e50-a007fc6feec7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:01.780081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bee52-0d54-4257-88cf-e4666d28e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:01.780836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bee52-0d54-4257-88cf-e4666d28e85e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.781118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bee52-0d54-4257-88cf-e4666d28e85e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.781501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bee52-0d54-4257-88cf-e4666d28e85e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.791940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec796776-55ff-407f-98cd-ed61302b264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:01.792992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796776-55ff-407f-98cd-ed61302b264c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.793422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796776-55ff-407f-98cd-ed61302b264c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.794019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796776-55ff-407f-98cd-ed61302b264c None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.795569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec796776-55ff-407f-98cd-ed61302b264c None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:01.797784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec796776-55ff-407f-98cd-ed61302b264c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:01.800323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 113/223] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:01 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:01.805568 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bee52-0d54-4257-88cf-e4666d28e85e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:01.808173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec796776-55ff-407f-98cd-ed61302b264c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4d3bee52-0d54-4257-88cf-e4666d28e85e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:01.808291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:01.809161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:01.810049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 111/224] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:08:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:01.816577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bee52-0d54-4257-88cf-e4666d28e85e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:01.878241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:01.883470 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:01.945910 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bee52-0d54-4257-88cf-e4666d28e85e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:01.984306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec796776-55ff-407f-98cd-ed61302b264c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:01.985851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:01.986477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:01.986765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:01.987211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:01.987954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:01.988266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:01.990503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:02.005722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 112/225] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:02.006935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:02.035706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:02.036747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:02.037781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:02.038256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:02.039895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] RBAC: Adding query filter params (role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=12e668dc7f0d447dbd96817dbaa612de, user.id=68b954d63be14294ae419778045e8037) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:02.040641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:02.042678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:02.048613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 114/226] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:01 2022] GET /identity/v3/role_assignments?user.id=68b954d63be14294ae419778045e8037&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:02.049857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:02.137298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8235c-dacf-4464-9559-a71b7139ba79 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:02.161237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:02.226479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbeadb-b10a-494a-b828-550b15b4ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:02.227506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbeadb-b10a-494a-b828-550b15b4ad97 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:02.227954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbeadb-b10a-494a-b828-550b15b4ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:02.228437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbeadb-b10a-494a-b828-550b15b4ad97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:02.253028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:02.258301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbeadb-b10a-494a-b828-550b15b4ad97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dcdbeadb-b10a-494a-b828-550b15b4ad97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:02.266661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:02.267839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:02.268754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:02.270769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 113/227] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:02.277570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbeadb-b10a-494a-b828-550b15b4ad97 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:02.283902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812605e-893b-4db9-ba4f-5e016535a9c6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:02.359771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144711-bb7a-4e49-a3af-660e7d19c486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:02.360742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144711-bb7a-4e49-a3af-660e7d19c486 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:02.361167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144711-bb7a-4e49-a3af-660e7d19c486 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:02.361648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144711-bb7a-4e49-a3af-660e7d19c486 None admin] PATH_INFO: `/v3/users/06c364d66c864209b6627ae06f697f32` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:02.363555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144711-bb7a-4e49-a3af-660e7d19c486 None admin] RBAC: Authorizing `identity:get_user(user_id=06c364d66c864209b6627ae06f697f32)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:02.369138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144711-bb7a-4e49-a3af-660e7d19c486 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:02.373564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 115/228] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:02 2022] GET /identity/v3/users/06c364d66c864209b6627ae06f697f32 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:02.382762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144711-bb7a-4e49-a3af-660e7d19c486 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:02.446774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbeadb-b10a-494a-b828-550b15b4ad97 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:02.497902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:02.499033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:02.499716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:02.500332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:02.501711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:02.502566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:02.505013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:02.522690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 114/229] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:02.524777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:02.585525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:02.652067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144711-bb7a-4e49-a3af-660e7d19c486 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:02.692474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694bc80-9ecc-458b-a028-17714b0478fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:02.693320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694bc80-9ecc-458b-a028-17714b0478fb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:02.693633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694bc80-9ecc-458b-a028-17714b0478fb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:02.694146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694bc80-9ecc-458b-a028-17714b0478fb None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:02.695393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694bc80-9ecc-458b-a028-17714b0478fb None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:02.697104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694bc80-9ecc-458b-a028-17714b0478fb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:02.699018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 116/230] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:02 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:02.704756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694bc80-9ecc-458b-a028-17714b0478fb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:02.709162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0821-997a-4620-8d9c-ca4261b853e2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:02.743655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:02.807707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57fe72-7fc7-408a-baa5-189a9f0dbb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:02.808406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57fe72-7fc7-408a-baa5-189a9f0dbb11 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:02.808690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57fe72-7fc7-408a-baa5-189a9f0dbb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:02.808968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57fe72-7fc7-408a-baa5-189a9f0dbb11 None admin] PATH_INFO: `/v3/users/06c364d66c864209b6627ae06f697f32` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:02.811623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57fe72-7fc7-408a-baa5-189a9f0dbb11 None admin] RBAC: Authorizing `identity:get_user(user_id=06c364d66c864209b6627ae06f697f32)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:02.813350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57fe72-7fc7-408a-baa5-189a9f0dbb11 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:02.818613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 115/231] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:02 2022] GET /identity/v3/users/06c364d66c864209b6627ae06f697f32 => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:02.826320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57fe72-7fc7-408a-baa5-189a9f0dbb11 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:02.867178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694bc80-9ecc-458b-a028-17714b0478fb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:02.970798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ab621-7513-471d-bddf-d0a57f06553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:02.971781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ab621-7513-471d-bddf-d0a57f06553e None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:02.972232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ab621-7513-471d-bddf-d0a57f06553e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:02.972696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ab621-7513-471d-bddf-d0a57f06553e None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de/users/06c364d66c864209b6627ae06f697f32/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:02.982948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ab621-7513-471d-bddf-d0a57f06553e None admin] RBAC: Authorizing `identity:create_grant(project_id=12e668dc7f0d447dbd96817dbaa612de, user_id=06c364d66c864209b6627ae06f697f32, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:02.985155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:02.985986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ab621-7513-471d-bddf-d0a57f06553e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:02.991363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57fe72-7fc7-408a-baa5-189a9f0dbb11 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:03.016997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 117/232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:02 2022] PUT /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de/users/06c364d66c864209b6627ae06f697f32/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:03.051686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366c108-da46-4975-98ee-bf0821a1ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:03.052764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c108-da46-4975-98ee-bf0821a1ea28 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:03.053266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c108-da46-4975-98ee-bf0821a1ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:03.053750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c108-da46-4975-98ee-bf0821a1ea28 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:03.055275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366c108-da46-4975-98ee-bf0821a1ea28 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:03.057044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366c108-da46-4975-98ee-bf0821a1ea28 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:03.059462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 116/233] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:02 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:03.065885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ab621-7513-471d-bddf-d0a57f06553e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:03.207941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:03.225140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ab621-7513-471d-bddf-d0a57f06553e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:03.290713 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468daf5e-d2bd-4c19-ae6d-217802d6478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:03.291662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468daf5e-d2bd-4c19-ae6d-217802d6478f None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:03.291909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468daf5e-d2bd-4c19-ae6d-217802d6478f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:03.292189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468daf5e-d2bd-4c19-ae6d-217802d6478f None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de/users/06c364d66c864209b6627ae06f697f32/roles/88a411c5f867401fb95db3c20cd8f8f1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:03.294755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468daf5e-d2bd-4c19-ae6d-217802d6478f None admin] RBAC: Authorizing `identity:create_grant(project_id=12e668dc7f0d447dbd96817dbaa612de, user_id=06c364d66c864209b6627ae06f697f32, role_id=88a411c5f867401fb95db3c20cd8f8f1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:03.296431 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468daf5e-d2bd-4c19-ae6d-217802d6478f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:03.315719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 118/234] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:03 2022] PUT /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de/users/06c364d66c864209b6627ae06f697f32/roles/88a411c5f867401fb95db3c20cd8f8f1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:04.776673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b869e-792d-41cf-a588-1aa817b06628 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:04.777209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b869e-792d-41cf-a588-1aa817b06628 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:04.777503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b869e-792d-41cf-a588-1aa817b06628 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:04.780036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 117/235] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:04.788777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683880c-491a-4dea-bd2f-f604baf57bf0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:04.789301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683880c-491a-4dea-bd2f-f604baf57bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:04.789630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683880c-491a-4dea-bd2f-f604baf57bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:04.819094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8683880c-491a-4dea-bd2f-f604baf57bf0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:04.820819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8683880c-491a-4dea-bd2f-f604baf57bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:04.967903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 119/236] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:04.976425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843957-8548-4cab-91f8-4aa337c28241 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:04.977059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843957-8548-4cab-91f8-4aa337c28241 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:04.977643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843957-8548-4cab-91f8-4aa337c28241 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:04.980310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 118/237] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:04.986927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb418-f23a-4546-99a4-abc8328a4f3d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:04.987418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb418-f23a-4546-99a4-abc8328a4f3d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:04.987948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb418-f23a-4546-99a4-abc8328a4f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:05.031847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-799cb418-f23a-4546-99a4-abc8328a4f3d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:05.033905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-799cb418-f23a-4546-99a4-abc8328a4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:05.158970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:05.236272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8995e-cdff-4093-b59c-61517709b4f3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:05.236899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8995e-cdff-4093-b59c-61517709b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:05.237395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8995e-cdff-4093-b59c-61517709b4f3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:05.239283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 119/239] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:05.245047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc5ea0-c29d-4964-8bd0-53132cba9d2a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:05.245606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc5ea0-c29d-4964-8bd0-53132cba9d2a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:05.246077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc5ea0-c29d-4964-8bd0-53132cba9d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:05.266705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f7cc5ea0-c29d-4964-8bd0-53132cba9d2a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:05.268331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f7cc5ea0-c29d-4964-8bd0-53132cba9d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:05.270635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:05.331100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8995e-cdff-4093-b59c-61517709b4f3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:05.408533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 121/240] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:05.492679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8995e-cdff-4093-b59c-61517709b4f3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:05.547078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76494-0545-4cfe-a1f9-506a6daea44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:05.547736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76494-0545-4cfe-a1f9-506a6daea44c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:05.548024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76494-0545-4cfe-a1f9-506a6daea44c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:05.548303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76494-0545-4cfe-a1f9-506a6daea44c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:05.563656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff76494-0545-4cfe-a1f9-506a6daea44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-eff76494-0545-4cfe-a1f9-506a6daea44c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:05.572709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:05.573718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:05.574510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 120/241] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:05.580170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc5ea0-c29d-4964-8bd0-53132cba9d2a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:05.651333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76494-0545-4cfe-a1f9-506a6daea44c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:05.713292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc5ea0-c29d-4964-8bd0-53132cba9d2a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:05.734613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:05.761280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:05.761984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:05.762255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:05.762586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:05.763160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:05.764033 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:05.765512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:05.773738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:05.779642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 122/242] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:05.780513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:05.848381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76494-0545-4cfe-a1f9-506a6daea44c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:05.890978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a556e-483a-40d9-a5a1-46779ad0bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:05.891616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a556e-483a-40d9-a5a1-46779ad0bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:05.891900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a556e-483a-40d9-a5a1-46779ad0bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:05.892176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a556e-483a-40d9-a5a1-46779ad0bfa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:05.893881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a556e-483a-40d9-a5a1-46779ad0bfa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:05.896877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a556e-483a-40d9-a5a1-46779ad0bfa8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:05.901085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 121/243] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:05.902421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a556e-483a-40d9-a5a1-46779ad0bfa8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:05.904517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660c576-486d-40ad-9a30-2267eba7b0f5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:05.948872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d6f38-7e78-46f2-93a9-4d93e2b965bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:05.949999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d6f38-7e78-46f2-93a9-4d93e2b965bb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:05.950477 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d6f38-7e78-46f2-93a9-4d93e2b965bb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:05.950970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d6f38-7e78-46f2-93a9-4d93e2b965bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:05.970290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d6f38-7e78-46f2-93a9-4d93e2b965bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-b44d6f38-7e78-46f2-93a9-4d93e2b965bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:05.977671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:05.978716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:05.979633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:05.982625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 123/244] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:05.988487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d6f38-7e78-46f2-93a9-4d93e2b965bb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:06.042238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:06.048439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a556e-483a-40d9-a5a1-46779ad0bfa8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:06.062540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:06.092500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173bce-7ab8-4ffc-978c-6f72e0412379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:06.093148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173bce-7ab8-4ffc-978c-6f72e0412379 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.093434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173bce-7ab8-4ffc-978c-6f72e0412379 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.093745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173bce-7ab8-4ffc-978c-6f72e0412379 None admin] PATH_INFO: `/v3/users/1608ee878b9647cb9ea11e6cce180ef7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.110190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173bce-7ab8-4ffc-978c-6f72e0412379 None admin] RBAC: Authorizing `identity:get_user(user_id=1608ee878b9647cb9ea11e6cce180ef7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:06.111672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173bce-7ab8-4ffc-978c-6f72e0412379 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:06.113614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 122/245] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:05 2022] GET /identity/v3/users/1608ee878b9647cb9ea11e6cce180ef7 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:06.118702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173bce-7ab8-4ffc-978c-6f72e0412379 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:06.122193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d6f38-7e78-46f2-93a9-4d93e2b965bb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:06.169139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0e5ee-012a-4653-8625-41de444dc3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:06.170044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0e5ee-012a-4653-8625-41de444dc3ec None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.170405 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0e5ee-012a-4653-8625-41de444dc3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.170830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0e5ee-012a-4653-8625-41de444dc3ec None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.171560 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0e5ee-012a-4653-8625-41de444dc3ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:06.173026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0e5ee-012a-4653-8625-41de444dc3ec None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:06.205417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 124/246] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:08:05 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:06.206795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f1c69-22ab-4649-bf6e-ad60848621e8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.207072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f1c69-22ab-4649-bf6e-ad60848621e8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.207365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f1c69-22ab-4649-bf6e-ad60848621e8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.208778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 125/247] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:06.209866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f1c69-22ab-4649-bf6e-ad60848621e8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:06.296278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173bce-7ab8-4ffc-978c-6f72e0412379 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:06.346871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64054-3103-41bc-95fd-2c448615a2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:06.347696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64054-3103-41bc-95fd-2c448615a2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.348331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64054-3103-41bc-95fd-2c448615a2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.348331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64054-3103-41bc-95fd-2c448615a2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.348935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c64054-3103-41bc-95fd-2c448615a2e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:06.349275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c64054-3103-41bc-95fd-2c448615a2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:06.351081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c64054-3103-41bc-95fd-2c448615a2e7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:06.366763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 123/248] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:06.366763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b794-2339-4408-bf1b-750f68932cf6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.366763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b794-2339-4408-bf1b-750f68932cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.366763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b794-2339-4408-bf1b-750f68932cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.391841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4943b794-2339-4408-bf1b-750f68932cf6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:06.393272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f1c69-22ab-4649-bf6e-ad60848621e8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:06.393581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4943b794-2339-4408-bf1b-750f68932cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:06.411916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:06.424765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:06.460536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efc87f-5f2c-4a1a-9dbc-e1f19e2f3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:06.461172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc87f-5f2c-4a1a-9dbc-e1f19e2f3668 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.461452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc87f-5f2c-4a1a-9dbc-e1f19e2f3668 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.461756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc87f-5f2c-4a1a-9dbc-e1f19e2f3668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.499523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 124/249] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:06.500737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b794-2339-4408-bf1b-750f68932cf6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:06.591397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efc87f-5f2c-4a1a-9dbc-e1f19e2f3668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:06.593015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efc87f-5f2c-4a1a-9dbc-e1f19e2f3668 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:06.657517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b794-2339-4408-bf1b-750f68932cf6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:06.714380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a853058-4078-42a9-b98e-52456e55ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:06.714959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853058-4078-42a9-b98e-52456e55ad13 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.715273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853058-4078-42a9-b98e-52456e55ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.715552 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853058-4078-42a9-b98e-52456e55ad13 None admin] PATH_INFO: `/v3/users/68b954d63be14294ae419778045e8037` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.716769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a853058-4078-42a9-b98e-52456e55ad13 None admin] RBAC: Authorizing `identity:get_user(user_id=68b954d63be14294ae419778045e8037)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:06.718299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a853058-4078-42a9-b98e-52456e55ad13 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:06.720646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 125/250] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:06 2022] GET /identity/v3/users/68b954d63be14294ae419778045e8037 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:06.724147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a661cc4-eed3-4277-94e7-b2870bf8e4a9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.725505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a661cc4-eed3-4277-94e7-b2870bf8e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.726035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a661cc4-eed3-4277-94e7-b2870bf8e4a9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.728435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 126/251] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:06.730013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a661cc4-eed3-4277-94e7-b2870bf8e4a9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:06.756439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:06.760890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 126/252] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:06.762381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254247-bfa8-4cde-8b60-8e73790f305a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.762757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254247-bfa8-4cde-8b60-8e73790f305a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.763340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254247-bfa8-4cde-8b60-8e73790f305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.791410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-56254247-bfa8-4cde-8b60-8e73790f305a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:06.793755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-56254247-bfa8-4cde-8b60-8e73790f305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:06.810724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:06.884722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a661cc4-eed3-4277-94e7-b2870bf8e4a9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:06.887638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 127/253] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:06.888323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56254247-bfa8-4cde-8b60-8e73790f305a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:06.922334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6108b-28f7-44e8-879c-28870252f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:06.922998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6108b-28f7-44e8-879c-28870252f25b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:06.923466 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6108b-28f7-44e8-879c-28870252f25b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:06.923773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6108b-28f7-44e8-879c-28870252f25b None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:06.925007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6108b-28f7-44e8-879c-28870252f25b None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:06.926498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6108b-28f7-44e8-879c-28870252f25b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:06.928966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 127/254] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:06 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:06.929648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6108b-28f7-44e8-879c-28870252f25b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:07.019491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:07.028897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56254247-bfa8-4cde-8b60-8e73790f305a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:07.040149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6108b-28f7-44e8-879c-28870252f25b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:07.073626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99482c-c51f-453d-84bb-e167273922c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:07.074406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99482c-c51f-453d-84bb-e167273922c8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:07.074794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99482c-c51f-453d-84bb-e167273922c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:07.075080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99482c-c51f-453d-84bb-e167273922c8 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:07.076660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99482c-c51f-453d-84bb-e167273922c8 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:07.077726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160f9a9-f853-4d0c-a4eb-447c9c72bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:07.078370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160f9a9-f853-4d0c-a4eb-447c9c72bcee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:07.078517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99482c-c51f-453d-84bb-e167273922c8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:07.078649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160f9a9-f853-4d0c-a4eb-447c9c72bcee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:07.078913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160f9a9-f853-4d0c-a4eb-447c9c72bcee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:07.080999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 128/255] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:06 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:07.086945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99482c-c51f-453d-84bb-e167273922c8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:07.092242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160f9a9-f853-4d0c-a4eb-447c9c72bcee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1160f9a9-f853-4d0c-a4eb-447c9c72bcee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:07.101604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:07.102641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:07.103738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:07.107464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 128/256] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:07.108488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160f9a9-f853-4d0c-a4eb-447c9c72bcee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:07.110686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:07.228498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160f9a9-f853-4d0c-a4eb-447c9c72bcee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:07.238318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99482c-c51f-453d-84bb-e167273922c8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:07.279361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:07.279899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:07.280178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:07.280448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:07.281192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] RBAC: Adding query filter params (role.id=42427d2d58f0468cb0d9d1d3e97617a7, scope.project.id=12e668dc7f0d447dbd96817dbaa612de, user.id=1608ee878b9647cb9ea11e6cce180ef7) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:07.281503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:07.282969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:07.293049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 129/257] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:07 2022] GET /identity/v3/role_assignments?user.id=1608ee878b9647cb9ea11e6cce180ef7&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=42427d2d58f0468cb0d9d1d3e97617a7 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:07.295587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:07.314796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6975b60-af29-4c77-9c4e-6b389a0978bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:07.315649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6975b60-af29-4c77-9c4e-6b389a0978bb None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:07.315956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6975b60-af29-4c77-9c4e-6b389a0978bb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:07.316295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6975b60-af29-4c77-9c4e-6b389a0978bb None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de/users/68b954d63be14294ae419778045e8037/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:07.320444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6975b60-af29-4c77-9c4e-6b389a0978bb None admin] RBAC: Authorizing `identity:create_grant(project_id=12e668dc7f0d447dbd96817dbaa612de, user_id=68b954d63be14294ae419778045e8037, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:07.324661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6975b60-af29-4c77-9c4e-6b389a0978bb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:07.330471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:07.350429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 129/258] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:07 2022] PUT /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de/users/68b954d63be14294ae419778045e8037/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:07.446521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6975b60-af29-4c77-9c4e-6b389a0978bb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:07.464842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa39167-61e0-4337-833d-99e9ce8d8b7b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:07.553821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:07.554377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:07.555865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:07.556205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:07.557005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:07.557587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:07.559146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:07.581889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 130/259] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:07.594811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:07.636361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:07.701528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:07.731770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6975b60-af29-4c77-9c4e-6b389a0978bb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:07.745571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2978-5dca-44c5-bb29-64c2206feb93 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:07.788447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab94309-4318-40c6-8867-4895ba7e6833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:07.789269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab94309-4318-40c6-8867-4895ba7e6833 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:07.789682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab94309-4318-40c6-8867-4895ba7e6833 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:07.790138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab94309-4318-40c6-8867-4895ba7e6833 None admin] PATH_INFO: `/v3/users/06c364d66c864209b6627ae06f697f32` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:07.791500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab94309-4318-40c6-8867-4895ba7e6833 None admin] RBAC: Authorizing `identity:get_user(user_id=06c364d66c864209b6627ae06f697f32)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:07.793876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab94309-4318-40c6-8867-4895ba7e6833 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:07.796045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 131/260] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:07 2022] GET /identity/v3/users/06c364d66c864209b6627ae06f697f32 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:07.803626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab94309-4318-40c6-8867-4895ba7e6833 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:07.817809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3726c1-d66c-4e3e-9862-2d5cf7ac2ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:07.818334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3726c1-d66c-4e3e-9862-2d5cf7ac2ead None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:07.819007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3726c1-d66c-4e3e-9862-2d5cf7ac2ead None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:07.819007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3726c1-d66c-4e3e-9862-2d5cf7ac2ead None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:07.846185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3726c1-d66c-4e3e-9862-2d5cf7ac2ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fc3726c1-d66c-4e3e-9862-2d5cf7ac2ead None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:07.852094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:07.853109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:07.854105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 130/261] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:07.861442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3726c1-d66c-4e3e-9862-2d5cf7ac2ead None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:07.973477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab94309-4318-40c6-8867-4895ba7e6833 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:08.013411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a8952-7adf-4e2c-b5fb-03af911f9a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:08.014160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a8952-7adf-4e2c-b5fb-03af911f9a80 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:08.014522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a8952-7adf-4e2c-b5fb-03af911f9a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:08.014837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a8952-7adf-4e2c-b5fb-03af911f9a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:08.018929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:08.084294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3726c1-d66c-4e3e-9862-2d5cf7ac2ead None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:08.099543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a8952-7adf-4e2c-b5fb-03af911f9a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:08.101573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a8952-7adf-4e2c-b5fb-03af911f9a80 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:08.171032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:08.171664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:08.171952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:08.172233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:08.172920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:08.173228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:08.179056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:08.180704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:08.196630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 131/262] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:08.215611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:08.232583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 132/263] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:08.243131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a8952-7adf-4e2c-b5fb-03af911f9a80 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:08.327606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:08.353732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489820c9-94a8-4aaf-bd27-a36ed707ad2f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:08.413624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d13cb0-d312-4d21-9859-f4db26ef0ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:08.414286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d13cb0-d312-4d21-9859-f4db26ef0ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:08.414570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d13cb0-d312-4d21-9859-f4db26ef0ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:08.414849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d13cb0-d312-4d21-9859-f4db26ef0ad1 None admin] PATH_INFO: `/v3/users/06c364d66c864209b6627ae06f697f32` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:08.416125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d13cb0-d312-4d21-9859-f4db26ef0ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=06c364d66c864209b6627ae06f697f32)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:08.417729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d13cb0-d312-4d21-9859-f4db26ef0ad1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:08.419732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 132/264] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:08 2022] GET /identity/v3/users/06c364d66c864209b6627ae06f697f32 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:08.433102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d13cb0-d312-4d21-9859-f4db26ef0ad1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:08.436394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a8952-7adf-4e2c-b5fb-03af911f9a80 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:08.505036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffddadc-2ba9-4bbf-983d-03fe0bf16ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:08.506215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffddadc-2ba9-4bbf-983d-03fe0bf16ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:08.506369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffddadc-2ba9-4bbf-983d-03fe0bf16ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:08.506646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffddadc-2ba9-4bbf-983d-03fe0bf16ac4 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:08.507812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffddadc-2ba9-4bbf-983d-03fe0bf16ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:08.509397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffddadc-2ba9-4bbf-983d-03fe0bf16ac4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:08.517667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 133/265] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:08 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:08.522784 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffddadc-2ba9-4bbf-983d-03fe0bf16ac4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:08.569778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:08.647636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d13cb0-d312-4d21-9859-f4db26ef0ad1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:08.718338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9709e5c-e37c-46bd-9813-c9a5c9dd55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:08.718972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709e5c-e37c-46bd-9813-c9a5c9dd55a7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:08.719287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709e5c-e37c-46bd-9813-c9a5c9dd55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:08.719538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9709e5c-e37c-46bd-9813-c9a5c9dd55a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:08.721800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffddadc-2ba9-4bbf-983d-03fe0bf16ac4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:08.730737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:08.830446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:08.831746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:08.832533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:08.833973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:08.836256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12e668dc7f0d447dbd96817dbaa612de, user.id=06c364d66c864209b6627ae06f697f32) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:08.837055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:08.839912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:08.854861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9709e5c-e37c-46bd-9813-c9a5c9dd55a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:08.856530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9709e5c-e37c-46bd-9813-c9a5c9dd55a7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:08.858086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 134/266] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:08 2022] GET /identity/v3/role_assignments?user.id=06c364d66c864209b6627ae06f697f32&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:08.948341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:08.987813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 133/267] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:08.994274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:09.180081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957aad-ed9c-423e-b772-f833919b0315 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:09.229280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94871e2e-da40-427e-8807-4b1b5a20259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:09.229879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871e2e-da40-427e-8807-4b1b5a20259f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:09.230160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871e2e-da40-427e-8807-4b1b5a20259f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:09.230432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871e2e-da40-427e-8807-4b1b5a20259f None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:09.234233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94871e2e-da40-427e-8807-4b1b5a20259f None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:09.235776 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94871e2e-da40-427e-8807-4b1b5a20259f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:09.238219 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 135/268] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:08 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:09.245475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9709e5c-e37c-46bd-9813-c9a5c9dd55a7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:09.397797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9709e5c-e37c-46bd-9813-c9a5c9dd55a7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:09.449166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5011983-cb9b-447e-a4e4-a5aa914cf891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:09.449821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5011983-cb9b-447e-a4e4-a5aa914cf891 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:09.450102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5011983-cb9b-447e-a4e4-a5aa914cf891 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:09.450380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5011983-cb9b-447e-a4e4-a5aa914cf891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:09.451125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5011983-cb9b-447e-a4e4-a5aa914cf891 None admin] RBAC: Adding query filter params (role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=12e668dc7f0d447dbd96817dbaa612de, user.id=06c364d66c864209b6627ae06f697f32) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:09.451435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5011983-cb9b-447e-a4e4-a5aa914cf891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:09.452892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5011983-cb9b-447e-a4e4-a5aa914cf891 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:09.463437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 134/269] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:09 2022] GET /identity/v3/role_assignments?user.id=06c364d66c864209b6627ae06f697f32&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:09.824991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c64e-430b-43c8-aa64-12a069ce44ae None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:09.825368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c64e-430b-43c8-aa64-12a069ce44ae None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:09.825620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c64e-430b-43c8-aa64-12a069ce44ae None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:09.827270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 136/270] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:09.832942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db2e02-a0b2-48a9-811e-77894f2d5376 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:09.833262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db2e02-a0b2-48a9-811e-77894f2d5376 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:09.833810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db2e02-a0b2-48a9-811e-77894f2d5376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:09.863691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-41db2e02-a0b2-48a9-811e-77894f2d5376 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:09.865261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-41db2e02-a0b2-48a9-811e-77894f2d5376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:09.902864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:09.970627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 135/271] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:10.275810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76c64e-430b-43c8-aa64-12a069ce44ae None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:10.336131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:10.359413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5573a-47d4-4dca-b330-0f1190a15769 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.359930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5573a-47d4-4dca-b330-0f1190a15769 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.359930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5573a-47d4-4dca-b330-0f1190a15769 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.361457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 136/272] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:08:10.368818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe8c1e-47e0-494e-9424-fa9f3514ef35 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.369176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe8c1e-47e0-494e-9424-fa9f3514ef35 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.369437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe8c1e-47e0-494e-9424-fa9f3514ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.394473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c2fe8c1e-47e0-494e-9424-fa9f3514ef35 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:10.396708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c2fe8c1e-47e0-494e-9424-fa9f3514ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:10.436697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76c64e-430b-43c8-aa64-12a069ce44ae None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:10.486298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2b24-52ed-4725-90a2-4ce1a7712a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:10.487294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2b24-52ed-4725-90a2-4ce1a7712a48 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.487760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2b24-52ed-4725-90a2-4ce1a7712a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.488239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2b24-52ed-4725-90a2-4ce1a7712a48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.495855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 137/273] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:10.509725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e2b24-52ed-4725-90a2-4ce1a7712a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ab8e2b24-52ed-4725-90a2-4ce1a7712a48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:10.514722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:10.515602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:10.516397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 137/274] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:10.524529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe8c1e-47e0-494e-9424-fa9f3514ef35 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:10.576784 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d56d3-dc87-4671-ba48-e6864710255d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.577495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d56d3-dc87-4671-ba48-e6864710255d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.577918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d56d3-dc87-4671-ba48-e6864710255d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.579472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 138/275] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:08:10.585756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2436-b7f4-45b2-9092-1089c8ec1104 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.586144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2436-b7f4-45b2-9092-1089c8ec1104 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.586550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2436-b7f4-45b2-9092-1089c8ec1104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.610306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9d4d2436-b7f4-45b2-9092-1089c8ec1104 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:10.611811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9d4d2436-b7f4-45b2-9092-1089c8ec1104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:10.635888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:10.653580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe8c1e-47e0-494e-9424-fa9f3514ef35 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:10.695929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d67fd4-5195-4b47-bcab-154a560ca0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:10.696904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67fd4-5195-4b47-bcab-154a560ca0ce None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.697357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67fd4-5195-4b47-bcab-154a560ca0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.697859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d67fd4-5195-4b47-bcab-154a560ca0ce None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.698723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d67fd4-5195-4b47-bcab-154a560ca0ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:10.699208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d67fd4-5195-4b47-bcab-154a560ca0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:10.701023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d67fd4-5195-4b47-bcab-154a560ca0ce None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:10.706566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 139/276] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:10.716042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 138/277] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:10.722674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d2436-b7f4-45b2-9092-1089c8ec1104 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:10.754944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36222f1-c4db-4cef-b866-217a1b4cd513 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.755774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36222f1-c4db-4cef-b866-217a1b4cd513 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.756055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36222f1-c4db-4cef-b866-217a1b4cd513 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.757861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 139/278] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:08:10.762049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:10.763048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135275-e6a3-40d3-adb1-8213f92f574d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.763349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135275-e6a3-40d3-adb1-8213f92f574d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.763609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135275-e6a3-40d3-adb1-8213f92f574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.786492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-dd135275-e6a3-40d3-adb1-8213f92f574d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:10.788708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dd135275-e6a3-40d3-adb1-8213f92f574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:10.846855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d2436-b7f4-45b2-9092-1089c8ec1104 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:10.873632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 140/279] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:10.874417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135275-e6a3-40d3-adb1-8213f92f574d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:10.902460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717c61-5362-4b58-889a-0c3f6003c3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:10.903869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717c61-5362-4b58-889a-0c3f6003c3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:10.904597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717c61-5362-4b58-889a-0c3f6003c3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:10.905518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717c61-5362-4b58-889a-0c3f6003c3f9 None admin] PATH_INFO: `/v3/users/0aee91cac9074e90b57f634ceb8f0c99` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:10.922600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1717c61-5362-4b58-889a-0c3f6003c3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=0aee91cac9074e90b57f634ceb8f0c99)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:10.925622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1717c61-5362-4b58-889a-0c3f6003c3f9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:10.929666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 140/280] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:10 2022] GET /identity/v3/users/0aee91cac9074e90b57f634ceb8f0c99 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:10.936282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717c61-5362-4b58-889a-0c3f6003c3f9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:10.978908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:11.003196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135275-e6a3-40d3-adb1-8213f92f574d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.035920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:11.047399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b6db-8b3b-4cb1-984b-358796d99e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:11.048423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b6db-8b3b-4cb1-984b-358796d99e99 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:11.048900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b6db-8b3b-4cb1-984b-358796d99e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:11.049369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b6db-8b3b-4cb1-984b-358796d99e99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:11.050848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8b6db-8b3b-4cb1-984b-358796d99e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:11.053108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8b6db-8b3b-4cb1-984b-358796d99e99 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:11.053753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717c61-5362-4b58-889a-0c3f6003c3f9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.055523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 141/281] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:11.060622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b6db-8b3b-4cb1-984b-358796d99e99 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:11.092121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:11.092838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:11.093127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:11.093405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:11.094194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] RBAC: Adding query filter params (role.id=d33de683560f4a1d95bcd204be71dc4f, user.id=0aee91cac9074e90b57f634ceb8f0c99, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:11.094513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:11.096163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:11.104181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 141/282] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Oct 6 12:08:10 2022] GET /identity/v3/role_assignments?user.id=0aee91cac9074e90b57f634ceb8f0c99&scope.system=all&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:11.114098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:11.213983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b6db-8b3b-4cb1-984b-358796d99e99 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.256877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cd8c-9a2f-4f67-bf7f-1bdf1ca31a87 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.263493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91c70c-d345-44e5-b45b-ec5860da18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:11.264148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91c70c-d345-44e5-b45b-ec5860da18c7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:11.264455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91c70c-d345-44e5-b45b-ec5860da18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:11.264698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91c70c-d345-44e5-b45b-ec5860da18c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:11.281454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91c70c-d345-44e5-b45b-ec5860da18c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ce91c70c-d345-44e5-b45b-ec5860da18c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:11.287631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:11.289692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 142/283] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:11.291814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91c70c-d345-44e5-b45b-ec5860da18c7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:11.307341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6400a-c5a5-4d9c-b5a6-592c80b642b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:11.307951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:11.308050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6400a-c5a5-4d9c-b5a6-592c80b642b7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:11.308491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6400a-c5a5-4d9c-b5a6-592c80b642b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:11.308999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6400a-c5a5-4d9c-b5a6-592c80b642b7 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:11.310367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6400a-c5a5-4d9c-b5a6-592c80b642b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:11.313744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6400a-c5a5-4d9c-b5a6-592c80b642b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:11.343080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 142/284] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:08:11 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:11.344447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6400a-c5a5-4d9c-b5a6-592c80b642b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:11.350432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:11.437019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91c70c-d345-44e5-b45b-ec5860da18c7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.492525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5306-d698-4ae5-8daa-b8f8d7a344a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:11.493499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5306-d698-4ae5-8daa-b8f8d7a344a3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:11.494239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5306-d698-4ae5-8daa-b8f8d7a344a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:11.494900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5306-d698-4ae5-8daa-b8f8d7a344a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:11.504921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6400a-c5a5-4d9c-b5a6-592c80b642b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.509466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e5306-d698-4ae5-8daa-b8f8d7a344a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-df4e5306-d698-4ae5-8daa-b8f8d7a344a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:11.515591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:11.516620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:11.517507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 143/285] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:11.525507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5306-d698-4ae5-8daa-b8f8d7a344a3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:11.572332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:11.572839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:11.573259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:11.573583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:11.574979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:11.574979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:11.576619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:11.589303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 143/286] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:11.595013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:11.636974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:11.683729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e5306-d698-4ae5-8daa-b8f8d7a344a3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.705395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:11.745687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:11.746361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:11.746635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:11.746907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:11.748403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:11.748710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:11.750569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:11.762458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 144/287] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:11.765006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd5c0e-9b6b-464b-b572-63adc25aab85 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.769081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:11.815816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0142b9d-5dce-45fa-a13e-2d613ad5711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:11.816603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142b9d-5dce-45fa-a13e-2d613ad5711e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:11.817577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142b9d-5dce-45fa-a13e-2d613ad5711e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:11.817577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142b9d-5dce-45fa-a13e-2d613ad5711e None admin] PATH_INFO: `/v3/users/1608ee878b9647cb9ea11e6cce180ef7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:11.820446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0142b9d-5dce-45fa-a13e-2d613ad5711e None admin] RBAC: Authorizing `identity:get_user(user_id=1608ee878b9647cb9ea11e6cce180ef7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:11.820583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0142b9d-5dce-45fa-a13e-2d613ad5711e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:11.823293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 144/288] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:11 2022] GET /identity/v3/users/1608ee878b9647cb9ea11e6cce180ef7 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:11.835272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0142b9d-5dce-45fa-a13e-2d613ad5711e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:11.910837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25344d24-32b1-42d7-822a-9cbfa91f955e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:11.987318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:11.999837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0142b9d-5dce-45fa-a13e-2d613ad5711e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:12.007113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6076a-5a58-4e28-b456-d3fb9050fa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:12.007914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6076a-5a58-4e28-b456-d3fb9050fa78 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:12.008241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6076a-5a58-4e28-b456-d3fb9050fa78 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:12.008638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6076a-5a58-4e28-b456-d3fb9050fa78 None admin] PATH_INFO: `/v3/users/68b954d63be14294ae419778045e8037` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:12.010706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6076a-5a58-4e28-b456-d3fb9050fa78 None admin] RBAC: Authorizing `identity:get_user(user_id=68b954d63be14294ae419778045e8037)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:12.012982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6076a-5a58-4e28-b456-d3fb9050fa78 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:12.015218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 145/289] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:11 2022] GET /identity/v3/users/68b954d63be14294ae419778045e8037 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:12.030276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6076a-5a58-4e28-b456-d3fb9050fa78 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:12.070188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd2beb-f5bc-4835-8c1d-f394cd2b01b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:12.071185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2beb-f5bc-4835-8c1d-f394cd2b01b8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:12.071623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2beb-f5bc-4835-8c1d-f394cd2b01b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:12.072090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2beb-f5bc-4835-8c1d-f394cd2b01b8 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:12.074046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd2beb-f5bc-4835-8c1d-f394cd2b01b8 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:12.075891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd2beb-f5bc-4835-8c1d-f394cd2b01b8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:12.077792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 145/290] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:11 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:12.085416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd2beb-f5bc-4835-8c1d-f394cd2b01b8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:12.089721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:12.226377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd2beb-f5bc-4835-8c1d-f394cd2b01b8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:12.273006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70c69f-d7fd-4af9-a63e-f1f41d9e6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:12.274055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70c69f-d7fd-4af9-a63e-f1f41d9e6cdd None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:12.274687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70c69f-d7fd-4af9-a63e-f1f41d9e6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:12.275119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70c69f-d7fd-4af9-a63e-f1f41d9e6cdd None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de/users/1608ee878b9647cb9ea11e6cce180ef7/roles/42427d2d58f0468cb0d9d1d3e97617a7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:12.277883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70c69f-d7fd-4af9-a63e-f1f41d9e6cdd None admin] RBAC: Authorizing `identity:create_grant(project_id=12e668dc7f0d447dbd96817dbaa612de, user_id=1608ee878b9647cb9ea11e6cce180ef7, role_id=42427d2d58f0468cb0d9d1d3e97617a7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:12.280455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70c69f-d7fd-4af9-a63e-f1f41d9e6cdd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:12.300161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 146/291] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:12 2022] PUT /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de/users/1608ee878b9647cb9ea11e6cce180ef7/roles/42427d2d58f0468cb0d9d1d3e97617a7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:12.375310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6076a-5a58-4e28-b456-d3fb9050fa78 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:12.444758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3923-234b-4964-9034-70f35e5d90d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:12.445608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3923-234b-4964-9034-70f35e5d90d1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:12.445747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3923-234b-4964-9034-70f35e5d90d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:12.446176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3923-234b-4964-9034-70f35e5d90d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:12.548582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:12.555231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c3923-234b-4964-9034-70f35e5d90d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:12.556994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c3923-234b-4964-9034-70f35e5d90d1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:12.700435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 146/292] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:12.706411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70c69f-d7fd-4af9-a63e-f1f41d9e6cdd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:12.808705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:12.903034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70c69f-d7fd-4af9-a63e-f1f41d9e6cdd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:12.983945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a400858-257c-400e-94eb-5d6c75da0a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:12.985027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400858-257c-400e-94eb-5d6c75da0a96 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:12.985512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400858-257c-400e-94eb-5d6c75da0a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:12.986034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400858-257c-400e-94eb-5d6c75da0a96 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:12.988185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a400858-257c-400e-94eb-5d6c75da0a96 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:12.991466 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a400858-257c-400e-94eb-5d6c75da0a96 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:12.994642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 147/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:12 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:13.005579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3923-234b-4964-9034-70f35e5d90d1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:13.181453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:13.187913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3923-234b-4964-9034-70f35e5d90d1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:13.260349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e89746-f111-4f34-a763-d6a7b18b02d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:13.260974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89746-f111-4f34-a763-d6a7b18b02d5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:13.261251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89746-f111-4f34-a763-d6a7b18b02d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:13.261524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89746-f111-4f34-a763-d6a7b18b02d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:13.262373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89746-f111-4f34-a763-d6a7b18b02d5 None admin] RBAC: Adding query filter params (role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=12e668dc7f0d447dbd96817dbaa612de, user.id=68b954d63be14294ae419778045e8037) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:13.262682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89746-f111-4f34-a763-d6a7b18b02d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:13.264140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89746-f111-4f34-a763-d6a7b18b02d5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:13.280439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 147/294] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:13 2022] GET /identity/v3/role_assignments?user.id=68b954d63be14294ae419778045e8037&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:14.240998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb866ed-bb6e-41b7-a8ef-8747359ccada None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:14.241558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb866ed-bb6e-41b7-a8ef-8747359ccada None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:14.241558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb866ed-bb6e-41b7-a8ef-8747359ccada None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:14.243210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 148/295] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:14.248762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675c98-205e-4616-98e5-a3d85339d128 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:14.249626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675c98-205e-4616-98e5-a3d85339d128 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:14.250112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675c98-205e-4616-98e5-a3d85339d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:14.268994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b8675c98-205e-4616-98e5-a3d85339d128 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:14.270516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b8675c98-205e-4616-98e5-a3d85339d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:14.343933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 148/296] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:14.568895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb27c7-caf0-4697-89c6-c60492948891 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:14.569082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb27c7-caf0-4697-89c6-c60492948891 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:14.569366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb27c7-caf0-4697-89c6-c60492948891 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:14.570778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 149/297] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:14.576717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458e48-823d-4da4-b78d-05b97de4e3a3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:14.577053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458e48-823d-4da4-b78d-05b97de4e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:14.577334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458e48-823d-4da4-b78d-05b97de4e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:14.597750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-24458e48-823d-4da4-b78d-05b97de4e3a3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:14.599087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-24458e48-823d-4da4-b78d-05b97de4e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:14.617343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb27c7-caf0-4697-89c6-c60492948891 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:14.683910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 149/298] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:14.710758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec497c-f3ca-4f1a-9717-aab22033ec24 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:14.711090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec497c-f3ca-4f1a-9717-aab22033ec24 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:14.711301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec497c-f3ca-4f1a-9717-aab22033ec24 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:14.712770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 150/299] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:14.718200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d326-50cd-4215-b8f7-30e015654172 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:14.718477 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d326-50cd-4215-b8f7-30e015654172 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:14.718745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d326-50cd-4215-b8f7-30e015654172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:14.741331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cca2d326-50cd-4215-b8f7-30e015654172 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:14.742552 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cca2d326-50cd-4215-b8f7-30e015654172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:14.756218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb27c7-caf0-4697-89c6-c60492948891 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:14.769969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:14.790956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:14.799883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86105ef0-2da7-485c-90a9-e372c7191437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:14.800532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105ef0-2da7-485c-90a9-e372c7191437 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:14.800816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105ef0-2da7-485c-90a9-e372c7191437 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:14.801091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86105ef0-2da7-485c-90a9-e372c7191437 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:14.814673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86105ef0-2da7-485c-90a9-e372c7191437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-86105ef0-2da7-485c-90a9-e372c7191437 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:14.821181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:14.822216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:14.823029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:14.825438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 150/300] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:14.831603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86105ef0-2da7-485c-90a9-e372c7191437 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:14.841883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 151/301] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:14.937574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86105ef0-2da7-485c-90a9-e372c7191437 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:14.954039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d326-50cd-4215-b8f7-30e015654172 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:14.973274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:14.974512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:14.974948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:14.975224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:14.975899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:14.976202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:14.977588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:14.989666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 151/302] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:14.993488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:15.056709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:15.074042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d326-50cd-4215-b8f7-30e015654172 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:15.114125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627949-21ed-4687-b6be-855f05aff9ab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:15.117618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90c925-7c44-4a5c-be5a-a28421744536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:15.118268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c925-7c44-4a5c-be5a-a28421744536 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.118549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c925-7c44-4a5c-be5a-a28421744536 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.118826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c925-7c44-4a5c-be5a-a28421744536 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.131494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90c925-7c44-4a5c-be5a-a28421744536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ef90c925-7c44-4a5c-be5a-a28421744536 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:15.137745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:15.138792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:15.139778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 152/303] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:15.146218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90c925-7c44-4a5c-be5a-a28421744536 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:15.162898 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b85a16-1444-46b0-ac3c-a9e0b37a26a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:15.163576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b85a16-1444-46b0-ac3c-a9e0b37a26a4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.164107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b85a16-1444-46b0-ac3c-a9e0b37a26a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.164312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b85a16-1444-46b0-ac3c-a9e0b37a26a4 None admin] PATH_INFO: `/v3/users/0aee91cac9074e90b57f634ceb8f0c99` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.165655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b85a16-1444-46b0-ac3c-a9e0b37a26a4 None admin] RBAC: Authorizing `identity:get_user(user_id=0aee91cac9074e90b57f634ceb8f0c99)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:15.166803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:15.167173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b85a16-1444-46b0-ac3c-a9e0b37a26a4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:15.169090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 152/304] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:14 2022] GET /identity/v3/users/0aee91cac9074e90b57f634ceb8f0c99 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:15.174773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b85a16-1444-46b0-ac3c-a9e0b37a26a4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:15.281454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90c925-7c44-4a5c-be5a-a28421744536 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:15.282355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b85a16-1444-46b0-ac3c-a9e0b37a26a4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:15.305440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:15.316721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52dd5-ee3c-4785-84d9-9e60d79cfc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:15.317446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52dd5-ee3c-4785-84d9-9e60d79cfc74 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.318378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52dd5-ee3c-4785-84d9-9e60d79cfc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.318718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52dd5-ee3c-4785-84d9-9e60d79cfc74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.319878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc52dd5-ee3c-4785-84d9-9e60d79cfc74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:15.320705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9af162-63f5-4f5d-a5b3-e20795ffb4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:15.321322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af162-63f5-4f5d-a5b3-e20795ffb4fb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.321411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc52dd5-ee3c-4785-84d9-9e60d79cfc74 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:15.321653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af162-63f5-4f5d-a5b3-e20795ffb4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.321933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af162-63f5-4f5d-a5b3-e20795ffb4fb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.322618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9af162-63f5-4f5d-a5b3-e20795ffb4fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:15.322933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9af162-63f5-4f5d-a5b3-e20795ffb4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:15.323058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 153/305] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:15.324521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9af162-63f5-4f5d-a5b3-e20795ffb4fb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:15.328336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52dd5-ee3c-4785-84d9-9e60d79cfc74 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:15.334043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 153/306] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:15.335473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf466-3cc0-46c5-bfdd-2e5874a0bdb9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.335764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf466-3cc0-46c5-bfdd-2e5874a0bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.336041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf466-3cc0-46c5-bfdd-2e5874a0bdb9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.341939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 154/307] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:15.341939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdf466-3cc0-46c5-bfdd-2e5874a0bdb9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:15.417017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:15.436173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52dd5-ee3c-4785-84d9-9e60d79cfc74 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:15.443517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdf466-3cc0-46c5-bfdd-2e5874a0bdb9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:15.470900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae36b-e362-4167-9b1d-0a5554698c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:15.471573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae36b-e362-4167-9b1d-0a5554698c1c None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.471853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae36b-e362-4167-9b1d-0a5554698c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.472125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae36b-e362-4167-9b1d-0a5554698c1c None admin] PATH_INFO: `/v3/system/users/0aee91cac9074e90b57f634ceb8f0c99/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.473558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae36b-e362-4167-9b1d-0a5554698c1c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0aee91cac9074e90b57f634ceb8f0c99, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:15.476198 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae36b-e362-4167-9b1d-0a5554698c1c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:15.484089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b442c-163a-4424-9c5d-0837fdfa2504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:15.484702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b442c-163a-4424-9c5d-0837fdfa2504 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.484984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b442c-163a-4424-9c5d-0837fdfa2504 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.485254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b442c-163a-4424-9c5d-0837fdfa2504 None admin] PATH_INFO: `/v3/groups` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.485854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 154/308] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Oct 6 12:08:15 2022] PUT /identity/v3/system/users/0aee91cac9074e90b57f634ceb8f0c99/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:15.485997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b442c-163a-4424-9c5d-0837fdfa2504 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:15.486715 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae36b-e362-4167-9b1d-0a5554698c1c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:15.487362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b442c-163a-4424-9c5d-0837fdfa2504 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:15.507029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 155/309] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Oct 6 12:08:15 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:15.507029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40366ac-6830-4ffe-a0f0-9c68c1b0a57a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.507029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40366ac-6830-4ffe-a0f0-9c68c1b0a57a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.507029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40366ac-6830-4ffe-a0f0-9c68c1b0a57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.547022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c40366ac-6830-4ffe-a0f0-9c68c1b0a57a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:15.548465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c40366ac-6830-4ffe-a0f0-9c68c1b0a57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:15.607997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:15.661067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 156/310] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:15.694038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae36b-e362-4167-9b1d-0a5554698c1c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:15.729986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515da39-7b73-4113-86cb-0e68e53ab5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:15.730630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515da39-7b73-4113-86cb-0e68e53ab5fc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.730908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515da39-7b73-4113-86cb-0e68e53ab5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.731178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515da39-7b73-4113-86cb-0e68e53ab5fc None admin] PATH_INFO: `/v3/users/29dcdfa7b12a48dc93f08ae2e1ae30b0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.746549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515da39-7b73-4113-86cb-0e68e53ab5fc None admin] RBAC: Authorizing `identity:get_user(user_id=29dcdfa7b12a48dc93f08ae2e1ae30b0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:15.748030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515da39-7b73-4113-86cb-0e68e53ab5fc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:15.749913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 155/311] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:15 2022] GET /identity/v3/users/29dcdfa7b12a48dc93f08ae2e1ae30b0 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:15.756009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40366ac-6830-4ffe-a0f0-9c68c1b0a57a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:15.862421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40366ac-6830-4ffe-a0f0-9c68c1b0a57a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:15.898910 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:15.899815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:15.900263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:15.900701 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:15.901901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] RBAC: Adding query filter params (role.id=42427d2d58f0468cb0d9d1d3e97617a7, user.id=29dcdfa7b12a48dc93f08ae2e1ae30b0, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:15.902401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:15.904005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:15.910025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 157/312] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Oct 6 12:08:15 2022] GET /identity/v3/role_assignments?user.id=29dcdfa7b12a48dc93f08ae2e1ae30b0&scope.system=all&role.id=42427d2d58f0468cb0d9d1d3e97617a7 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:15.950634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515da39-7b73-4113-86cb-0e68e53ab5fc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:15.954021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:16.092456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515da39-7b73-4113-86cb-0e68e53ab5fc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:16.140945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df21c-fbe5-455e-89f6-845c734dc4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:16.141639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df21c-fbe5-455e-89f6-845c734dc4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:16.141888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df21c-fbe5-455e-89f6-845c734dc4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:16.142162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df21c-fbe5-455e-89f6-845c734dc4c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:16.154784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df21c-fbe5-455e-89f6-845c734dc4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-454df21c-fbe5-455e-89f6-845c734dc4c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:16.159899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:16.160981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:16.162365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 156/313] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:16.170069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:16.209843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:16.279627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233d969-9c64-4317-9daa-da9a6a619c44 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:16.316140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:16.317655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:16.318137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:16.318631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:16.319510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:16.320003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:16.321596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:16.331591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 158/314] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:16.337759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df21c-fbe5-455e-89f6-845c734dc4c8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:16.409646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:16.452493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df21c-fbe5-455e-89f6-845c734dc4c8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:16.491092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321369-89ac-4a29-a356-37495509a286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:16.492005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321369-89ac-4a29-a356-37495509a286 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:16.492538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321369-89ac-4a29-a356-37495509a286 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:16.492962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321369-89ac-4a29-a356-37495509a286 None admin] PATH_INFO: `/v3/users/1608ee878b9647cb9ea11e6cce180ef7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:16.494464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee321369-89ac-4a29-a356-37495509a286 None admin] RBAC: Authorizing `identity:get_user(user_id=1608ee878b9647cb9ea11e6cce180ef7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:16.496123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee321369-89ac-4a29-a356-37495509a286 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:16.502576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 157/315] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:16 2022] GET /identity/v3/users/1608ee878b9647cb9ea11e6cce180ef7 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:16.504492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:16.615208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:16.620516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edfa2-5eda-483a-8f67-47c4565dd439 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:16.656073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772923-18cc-47c6-aa20-8f7ec4415dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:16.656683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772923-18cc-47c6-aa20-8f7ec4415dff None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:16.656964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772923-18cc-47c6-aa20-8f7ec4415dff None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:16.657234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772923-18cc-47c6-aa20-8f7ec4415dff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:16.730649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19772923-18cc-47c6-aa20-8f7ec4415dff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:16.732026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19772923-18cc-47c6-aa20-8f7ec4415dff None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:16.835081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:16.841629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 159/316] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:16.847800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321369-89ac-4a29-a356-37495509a286 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:16.958528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321369-89ac-4a29-a356-37495509a286 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:16.988708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:16.995668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74dda0-a7f8-4589-bc66-a66b4ef59d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:16.996311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74dda0-a7f8-4589-bc66-a66b4ef59d50 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:16.996594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74dda0-a7f8-4589-bc66-a66b4ef59d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:16.996869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74dda0-a7f8-4589-bc66-a66b4ef59d50 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:16.998040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74dda0-a7f8-4589-bc66-a66b4ef59d50 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:16.999518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74dda0-a7f8-4589-bc66-a66b4ef59d50 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:17.001188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 158/317] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:16 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:17.007823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772923-18cc-47c6-aa20-8f7ec4415dff None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:17.113473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772923-18cc-47c6-aa20-8f7ec4415dff None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:17.150375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87568a-a00d-4706-8f81-ad4d92af643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:17.150983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87568a-a00d-4706-8f81-ad4d92af643b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:17.151524 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87568a-a00d-4706-8f81-ad4d92af643b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:17.151806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87568a-a00d-4706-8f81-ad4d92af643b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:17.152526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87568a-a00d-4706-8f81-ad4d92af643b None admin] RBAC: Adding query filter params (role.id=42427d2d58f0468cb0d9d1d3e97617a7, scope.project.id=12e668dc7f0d447dbd96817dbaa612de, user.id=1608ee878b9647cb9ea11e6cce180ef7) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:17.152832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87568a-a00d-4706-8f81-ad4d92af643b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:17.154280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87568a-a00d-4706-8f81-ad4d92af643b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:17.160490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 160/318] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:17 2022] GET /identity/v3/role_assignments?user.id=1608ee878b9647cb9ea11e6cce180ef7&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=42427d2d58f0468cb0d9d1d3e97617a7 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:17.806320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5cb8b-6f17-497f-963c-028c49645bea None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:17.806846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5cb8b-6f17-497f-963c-028c49645bea None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:17.806846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5cb8b-6f17-497f-963c-028c49645bea None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:17.808347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 159/319] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:17.813326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac6f5-630b-4ab2-a2da-754747136c05 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:17.813744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac6f5-630b-4ab2-a2da-754747136c05 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:17.813903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac6f5-630b-4ab2-a2da-754747136c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:17.832514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b59ac6f5-630b-4ab2-a2da-754747136c05 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:17.834288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b59ac6f5-630b-4ab2-a2da-754747136c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:17.890571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d04a8-a0d9-4abd-a557-dedca3f62335 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:17.890903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d04a8-a0d9-4abd-a557-dedca3f62335 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:17.891123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d04a8-a0d9-4abd-a557-dedca3f62335 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:17.892576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 160/320] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:08:17.893828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:17.898230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e61b5-93de-45d4-b097-a16883fd61a9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:17.898517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e61b5-93de-45d4-b097-a16883fd61a9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:17.898784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e61b5-93de-45d4-b097-a16883fd61a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:17.908723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 161/321] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:17.917116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1d7e61b5-93de-45d4-b097-a16883fd61a9 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:17.918356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1d7e61b5-93de-45d4-b097-a16883fd61a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:17.989577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 161/322] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:18.153878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34cb0e-3c2f-4045-9d93-0e50b6cf6f2f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.154186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34cb0e-3c2f-4045-9d93-0e50b6cf6f2f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.154442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34cb0e-3c2f-4045-9d93-0e50b6cf6f2f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.155823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 162/323] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:18.161695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504d7a-af3d-4bff-8dfc-a55c96845a5d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.162285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504d7a-af3d-4bff-8dfc-a55c96845a5d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.162583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504d7a-af3d-4bff-8dfc-a55c96845a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.182622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34cb0e-3c2f-4045-9d93-0e50b6cf6f2f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.182795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b3504d7a-af3d-4bff-8dfc-a55c96845a5d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:18.183929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b3504d7a-af3d-4bff-8dfc-a55c96845a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:18.260946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 162/324] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:18.262115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504d7a-af3d-4bff-8dfc-a55c96845a5d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.301084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34cb0e-3c2f-4045-9d93-0e50b6cf6f2f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:18.327713 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:18.342528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b87044-0eb9-44c9-bb65-0fc7c8b2b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:18.343168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87044-0eb9-44c9-bb65-0fc7c8b2b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.343448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87044-0eb9-44c9-bb65-0fc7c8b2b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.343721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87044-0eb9-44c9-bb65-0fc7c8b2b9f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.355453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b87044-0eb9-44c9-bb65-0fc7c8b2b9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d2b87044-0eb9-44c9-bb65-0fc7c8b2b9f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:18.360497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:18.361425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:18.362314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 163/325] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:18.367402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b87044-0eb9-44c9-bb65-0fc7c8b2b9f6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.378622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504d7a-af3d-4bff-8dfc-a55c96845a5d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:18.420127 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1164825-7643-4d11-891e-b4002911e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:18.420738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164825-7643-4d11-891e-b4002911e7bf None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.421022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164825-7643-4d11-891e-b4002911e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.421294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164825-7643-4d11-891e-b4002911e7bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.422679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1164825-7643-4d11-891e-b4002911e7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:18.424239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1164825-7643-4d11-891e-b4002911e7bf None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:18.426178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:18.427218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 163/326] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:18.433507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1164825-7643-4d11-891e-b4002911e7bf None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.484249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b87044-0eb9-44c9-bb65-0fc7c8b2b9f6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:18.522276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:18.523272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.523766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.524105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.524951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:18.525140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:18.526861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:18.537268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 164/327] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:18.538132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.542679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1164825-7643-4d11-891e-b4002911e7bf None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:18.569209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:18.578636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172131-5989-47d6-a092-22b8add98320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:18.579252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172131-5989-47d6-a092-22b8add98320 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.579540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172131-5989-47d6-a092-22b8add98320 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.579821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5172131-5989-47d6-a092-22b8add98320 None admin] PATH_INFO: `/v3/groups` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.580457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5172131-5989-47d6-a092-22b8add98320 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:18.581933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5172131-5989-47d6-a092-22b8add98320 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:18.598981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 164/328] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Oct 6 12:08:18 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:18.600568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172131-5989-47d6-a092-22b8add98320 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.648896 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d2610-16e8-42f8-afd2-347a1fa33bc6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:18.668257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:18.694066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae87157-4db9-452d-a367-f368f90ab855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:18.695090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae87157-4db9-452d-a367-f368f90ab855 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.695588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae87157-4db9-452d-a367-f368f90ab855 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.695993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae87157-4db9-452d-a367-f368f90ab855 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.709099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae87157-4db9-452d-a367-f368f90ab855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5ae87157-4db9-452d-a367-f368f90ab855 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:18.715134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:18.716092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:18.716883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 165/329] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:18.722508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae87157-4db9-452d-a367-f368f90ab855 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.725974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5172131-5989-47d6-a092-22b8add98320 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:18.766741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f14a-5a10-4cdd-805c-912c13ec36b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:18.767435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f14a-5a10-4cdd-805c-912c13ec36b3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.767713 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f14a-5a10-4cdd-805c-912c13ec36b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.768003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f14a-5a10-4cdd-805c-912c13ec36b3 None admin] PATH_INFO: `/v3/users/0aee91cac9074e90b57f634ceb8f0c99` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.769164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871f14a-5a10-4cdd-805c-912c13ec36b3 None admin] RBAC: Authorizing `identity:get_user(user_id=0aee91cac9074e90b57f634ceb8f0c99)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:18.771412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871f14a-5a10-4cdd-805c-912c13ec36b3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:18.773413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 165/330] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:18 2022] GET /identity/v3/users/0aee91cac9074e90b57f634ceb8f0c99 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:18.779174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f14a-5a10-4cdd-805c-912c13ec36b3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.856891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:18.857508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae87157-4db9-452d-a367-f368f90ab855 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:18.912106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:18.912730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.913018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.913303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.914549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:18.914862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:18.916255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:18.921957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f14a-5a10-4cdd-805c-912c13ec36b3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:18.925553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 166/331] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:18.931946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:18.963968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:18.964511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:18.964795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:18.965067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:18.965842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] RBAC: Adding query filter params (role.id=d33de683560f4a1d95bcd204be71dc4f, user.id=0aee91cac9074e90b57f634ceb8f0c99, scope.system=all) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:18.966181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:18.967749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:18.980392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:18.990897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 166/332] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Oct 6 12:08:18 2022] GET /identity/v3/role_assignments?user.id=0aee91cac9074e90b57f634ceb8f0c99&scope.system=all&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:19.069047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50189da-bf23-49e2-9326-f58ea8c2571c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:19.116647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ebb79-dea8-49b1-b440-84669801e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:19.117311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ebb79-dea8-49b1-b440-84669801e396 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:19.117621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ebb79-dea8-49b1-b440-84669801e396 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:19.117905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ebb79-dea8-49b1-b440-84669801e396 None admin] PATH_INFO: `/v3/users/29dcdfa7b12a48dc93f08ae2e1ae30b0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:19.119126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ebb79-dea8-49b1-b440-84669801e396 None admin] RBAC: Authorizing `identity:get_user(user_id=29dcdfa7b12a48dc93f08ae2e1ae30b0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:19.120680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ebb79-dea8-49b1-b440-84669801e396 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:19.122764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 167/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:18 2022] GET /identity/v3/users/29dcdfa7b12a48dc93f08ae2e1ae30b0 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:19.132195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:19.270334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a90fa-a3d9-4986-acf5-05e43b33ed97 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:19.288119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:19.316092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed468118-276d-41bd-92b6-ddb1272b3f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:19.316757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468118-276d-41bd-92b6-ddb1272b3f98 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:19.317102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468118-276d-41bd-92b6-ddb1272b3f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:19.317487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468118-276d-41bd-92b6-ddb1272b3f98 None admin] PATH_INFO: `/v3/system/users/29dcdfa7b12a48dc93f08ae2e1ae30b0/roles/42427d2d58f0468cb0d9d1d3e97617a7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:19.319080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed468118-276d-41bd-92b6-ddb1272b3f98 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=29dcdfa7b12a48dc93f08ae2e1ae30b0, role_id=42427d2d58f0468cb0d9d1d3e97617a7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:19.320477 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed468118-276d-41bd-92b6-ddb1272b3f98 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:19.339213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 167/334] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Oct 6 12:08:19 2022] PUT /identity/v3/system/users/29dcdfa7b12a48dc93f08ae2e1ae30b0/roles/42427d2d58f0468cb0d9d1d3e97617a7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:21.261456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d9f0-6447-44aa-8985-8bda15afec78 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:21.262024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d9f0-6447-44aa-8985-8bda15afec78 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:21.262024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d9f0-6447-44aa-8985-8bda15afec78 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:21.263746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 168/335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:21.269661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4f99-be2e-4f12-9b47-b7503b1a3867 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:21.271222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4f99-be2e-4f12-9b47-b7503b1a3867 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:21.271757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4f99-be2e-4f12-9b47-b7503b1a3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:21.302844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-fa0f4f99-be2e-4f12-9b47-b7503b1a3867 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:21.304446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fa0f4f99-be2e-4f12-9b47-b7503b1a3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:21.405051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 168/336] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:21.607108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc526e-3bc2-4947-8621-fa0892298387 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:21.607500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc526e-3bc2-4947-8621-fa0892298387 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:21.607696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc526e-3bc2-4947-8621-fa0892298387 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:21.609321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 169/337] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:21.615155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e0af-fd53-4571-800e-2e4ab4b1e260 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:21.615776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e0af-fd53-4571-800e-2e4ab4b1e260 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:21.616260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e0af-fd53-4571-800e-2e4ab4b1e260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:21.642729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1578e0af-fd53-4571-800e-2e4ab4b1e260 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:21.644431 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1578e0af-fd53-4571-800e-2e4ab4b1e260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:21.736907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 169/338] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:22.022042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc526e-3bc2-4947-8621-fa0892298387 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:22.159197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc526e-3bc2-4947-8621-fa0892298387 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:22.162714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:22.205012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67de86-e11c-46db-9cf5-3c817f61682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:22.205808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67de86-e11c-46db-9cf5-3c817f61682a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:22.206141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67de86-e11c-46db-9cf5-3c817f61682a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:22.206422 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67de86-e11c-46db-9cf5-3c817f61682a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:22.218357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67de86-e11c-46db-9cf5-3c817f61682a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3e67de86-e11c-46db-9cf5-3c817f61682a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:22.226214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:22.227132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:22.227914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 170/339] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:22.234855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578e0af-fd53-4571-800e-2e4ab4b1e260 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:22.303548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:22.378478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67de86-e11c-46db-9cf5-3c817f61682a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:22.396690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578e0af-fd53-4571-800e-2e4ab4b1e260 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:22.467380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:22.468044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:22.468395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:22.468671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:22.469460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:22.469794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:22.471209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:22.488231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 170/340] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:22.494436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:22.544513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67de86-e11c-46db-9cf5-3c817f61682a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:22.599295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712b75e-7f3c-40dc-b0d4-d8363bf6cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:22.599863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b75e-7f3c-40dc-b0d4-d8363bf6cc2b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:22.600146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b75e-7f3c-40dc-b0d4-d8363bf6cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:22.600419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b75e-7f3c-40dc-b0d4-d8363bf6cc2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:22.620265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712b75e-7f3c-40dc-b0d4-d8363bf6cc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d712b75e-7f3c-40dc-b0d4-d8363bf6cc2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:22.625736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:22.626681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:22.627787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:22.628452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 171/341] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:22.639367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712b75e-7f3c-40dc-b0d4-d8363bf6cc2b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:22.699038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:22.731756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:22.747616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983432a-2048-40d9-b1e1-21adcf43b2e4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:22.786662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712b75e-7f3c-40dc-b0d4-d8363bf6cc2b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:22.824925 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:22.825573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:22.825865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:22.826140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:22.827016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:22.827329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:22.828743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:22.838978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 172/342] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:22.840579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09534843-d36f-470e-bff1-ea28b982e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:22.841226 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534843-d36f-470e-bff1-ea28b982e8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:22.841510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534843-d36f-470e-bff1-ea28b982e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:22.841817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534843-d36f-470e-bff1-ea28b982e8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:22.844725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:22.957309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09534843-d36f-470e-bff1-ea28b982e8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:22.966118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09534843-d36f-470e-bff1-ea28b982e8e7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:22.966759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:22.985213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30648ee7-c090-41c9-b0ef-871868a4dcc8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:23.057068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40d907-f983-429c-96f9-e7acd24a8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:23.058000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d907-f983-429c-96f9-e7acd24a8c8b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.058282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d907-f983-429c-96f9-e7acd24a8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.058554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d907-f983-429c-96f9-e7acd24a8c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.168547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:23.175737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 171/343] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 12:08:23.182181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fac9-41e1-4dcb-ba2b-a033f38cbe5d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.182532 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fac9-41e1-4dcb-ba2b-a033f38cbe5d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.182750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fac9-41e1-4dcb-ba2b-a033f38cbe5d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.184525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 172/344] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:23.185761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7bf4-e684-4dfd-afc4-e615f8b0c398 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.186049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7bf4-e684-4dfd-afc4-e615f8b0c398 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.186323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7bf4-e684-4dfd-afc4-e615f8b0c398 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.187837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 173/345] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:23.188822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7bf4-e684-4dfd-afc4-e615f8b0c398 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:23.204573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40d907-f983-429c-96f9-e7acd24a8c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:23.206364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40d907-f983-429c-96f9-e7acd24a8c8b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:23.316854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:23.324688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7bf4-e684-4dfd-afc4-e615f8b0c398 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:23.339829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 173/346] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:23.340982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44adffc-8ced-471c-93bc-081f03a858ea None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.341237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44adffc-8ced-471c-93bc-081f03a858ea None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.341504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44adffc-8ced-471c-93bc-081f03a858ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.370263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c44adffc-8ced-471c-93bc-081f03a858ea None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:23.372035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c44adffc-8ced-471c-93bc-081f03a858ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:23.378855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d7cad-7057-4054-8c9f-243e96fb8b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:23.379750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7cad-7057-4054-8c9f-243e96fb8b5b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.380135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7cad-7057-4054-8c9f-243e96fb8b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.380509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7cad-7057-4054-8c9f-243e96fb8b5b None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.382230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d7cad-7057-4054-8c9f-243e96fb8b5b None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:23.383909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d7cad-7057-4054-8c9f-243e96fb8b5b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:23.386434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 174/347] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:23 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:23.387864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814df3-041b-43f0-bfcd-464c4a7a5e5a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.388418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814df3-041b-43f0-bfcd-464c4a7a5e5a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.388603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02814df3-041b-43f0-bfcd-464c4a7a5e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.413697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-02814df3-041b-43f0-bfcd-464c4a7a5e5a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:23.415164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-02814df3-041b-43f0-bfcd-464c4a7a5e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:23.465319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 174/348] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:23.466910 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8f81-ade6-4a27-b7ad-057b3c6db62f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.469324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8f81-ade6-4a27-b7ad-057b3c6db62f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.469324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8f81-ade6-4a27-b7ad-057b3c6db62f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.469324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 175/349] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:23.469803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8f81-ade6-4a27-b7ad-057b3c6db62f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:23.498537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:23.510697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 175/350] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:23.511467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02814df3-041b-43f0-bfcd-464c4a7a5e5a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:23.608923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8f81-ade6-4a27-b7ad-057b3c6db62f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:23.642458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:23.661251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68059cb3-14b9-4d00-9bd8-507b6c3ba3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:23.662555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059cb3-14b9-4d00-9bd8-507b6c3ba3ff None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.662990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059cb3-14b9-4d00-9bd8-507b6c3ba3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.663365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059cb3-14b9-4d00-9bd8-507b6c3ba3ff None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.663988 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02814df3-041b-43f0-bfcd-464c4a7a5e5a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:23.664774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68059cb3-14b9-4d00-9bd8-507b6c3ba3ff None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:23.666613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68059cb3-14b9-4d00-9bd8-507b6c3ba3ff None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:23.668531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 176/351] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:23 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:23.670768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5f006-7a68-4f70-acc0-059476b2a82c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.670768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5f006-7a68-4f70-acc0-059476b2a82c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.670768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5f006-7a68-4f70-acc0-059476b2a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.693443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ebb5f006-7a68-4f70-acc0-059476b2a82c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:23.695543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ebb5f006-7a68-4f70-acc0-059476b2a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:23.738879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf8187-22d3-4992-a888-bd53835e9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:23.740607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8187-22d3-4992-a888-bd53835e9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:23.741075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8187-22d3-4992-a888-bd53835e9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:23.741493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8187-22d3-4992-a888-bd53835e9fa6 None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:23.755071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf8187-22d3-4992-a888-bd53835e9fa6 None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:23.755071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf8187-22d3-4992-a888-bd53835e9fa6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:23.758469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 176/352] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:23 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:23.759357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf8187-22d3-4992-a888-bd53835e9fa6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:23.790530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 177/353] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:23.791476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5f006-7a68-4f70-acc0-059476b2a82c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:23.901950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:23.982359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf8187-22d3-4992-a888-bd53835e9fa6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:23.993905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5f006-7a68-4f70-acc0-059476b2a82c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:24.015527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:24.042925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a98bb6-503d-493a-a5de-1f47004c26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:24.043586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98bb6-503d-493a-a5de-1f47004c26ef None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.043870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98bb6-503d-493a-a5de-1f47004c26ef None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.044146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98bb6-503d-493a-a5de-1f47004c26ef None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.045381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:24.046037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.046315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.046585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.047342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] RBAC: Adding query filter params (group.id=9b0abf40f3984aa48f9b53dcc7da5f08, role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:24.047650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:24.049101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a98bb6-503d-493a-a5de-1f47004c26ef None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:24.050609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a98bb6-503d-493a-a5de-1f47004c26ef None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:24.052806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 177/354] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:23 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:24.053811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:24.058338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a98bb6-503d-493a-a5de-1f47004c26ef None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:24.061063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 178/355] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:23 2022] GET /identity/v3/role_assignments?group.id=9b0abf40f3984aa48f9b53dcc7da5f08&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:24.062318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:24.246604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a98bb6-503d-493a-a5de-1f47004c26ef None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:24.258490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1fbd7-e77f-4c7f-9b48-b9c36996b8d3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:24.290964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:24.296985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfae66-5073-4968-be12-da5d3c279bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:24.297832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfae66-5073-4968-be12-da5d3c279bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.298054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfae66-5073-4968-be12-da5d3c279bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.298335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfae66-5073-4968-be12-da5d3c279bd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.312088 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a82c-47d8-459d-8a5a-35d367a774de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:24.313133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a82c-47d8-459d-8a5a-35d367a774de None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.313425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a82c-47d8-459d-8a5a-35d367a774de None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.313737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a82c-47d8-459d-8a5a-35d367a774de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.318628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfae66-5073-4968-be12-da5d3c279bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f6bfae66-5073-4968-be12-da5d3c279bd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:24.324465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:24.325920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 178/356] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:24.329208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfae66-5073-4968-be12-da5d3c279bd5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:24.330049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43a82c-47d8-459d-8a5a-35d367a774de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0b43a82c-47d8-459d-8a5a-35d367a774de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:24.340787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:24.342242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 179/357] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:24.343086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a52b1-206e-4202-865f-4b725ab9bddd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.343818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a52b1-206e-4202-865f-4b725ab9bddd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.343818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a52b1-206e-4202-865f-4b725ab9bddd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.343818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 180/358] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:24.343818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a52b1-206e-4202-865f-4b725ab9bddd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:24.399124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:24.465102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfae66-5073-4968-be12-da5d3c279bd5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:24.484136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a52b1-206e-4202-865f-4b725ab9bddd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:24.512207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fdad1-1ab6-4b39-ac9d-25268317276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:24.512756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdad1-1ab6-4b39-ac9d-25268317276e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.513032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdad1-1ab6-4b39-ac9d-25268317276e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.513304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdad1-1ab6-4b39-ac9d-25268317276e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.514072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdad1-1ab6-4b39-ac9d-25268317276e None admin] RBAC: Adding query filter params (group.id=9b0abf40f3984aa48f9b53dcc7da5f08, role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:24.514381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdad1-1ab6-4b39-ac9d-25268317276e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:24.515844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdad1-1ab6-4b39-ac9d-25268317276e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:24.522654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 179/359] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:24 2022] GET /identity/v3/role_assignments?group.id=9b0abf40f3984aa48f9b53dcc7da5f08&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:24.523939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f2edd-38e1-476e-a0bf-774d77fd22d3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.524225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f2edd-38e1-476e-a0bf-774d77fd22d3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.524496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f2edd-38e1-476e-a0bf-774d77fd22d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.530061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697c16e-d312-4735-9f27-ace744626906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:24.531331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c16e-d312-4735-9f27-ace744626906 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.531829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c16e-d312-4735-9f27-ace744626906 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.533235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c16e-d312-4735-9f27-ace744626906 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.545893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ef2f2edd-38e1-476e-a0bf-774d77fd22d3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:24.547144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ef2f2edd-38e1-476e-a0bf-774d77fd22d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:24.548601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697c16e-d312-4735-9f27-ace744626906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1697c16e-d312-4735-9f27-ace744626906 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:24.556296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:24.557296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:24.559173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:24.566792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 181/360] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:24.566792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697c16e-d312-4735-9f27-ace744626906 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:24.625592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:24.655064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 180/361] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:24.656373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f2edd-38e1-476e-a0bf-774d77fd22d3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:24.730286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:24.733918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697c16e-d312-4735-9f27-ace744626906 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:24.773383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:24.774365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.774852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.775331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.776526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:24.777076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:24.779865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:24.790519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 182/362] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:24.791723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:24.811016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f2edd-38e1-476e-a0bf-774d77fd22d3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:24.855548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:24.856596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:24.857066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:24.857559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:24.858302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:24.858614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:24.860540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:24.872347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 181/363] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:24.873025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:24.932393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:24.995732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9945bb-cffb-4e0f-af70-46af8580556c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.008987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9be4ba-dfa4-40f0-b8a3-014a4eda5320 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.058386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f8595-0ec8-43c2-b58d-03ab278d333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:25.059452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f8595-0ec8-43c2-b58d-03ab278d333d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:25.059819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f8595-0ec8-43c2-b58d-03ab278d333d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:25.060154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f8595-0ec8-43c2-b58d-03ab278d333d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:25.067897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:25.068628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:25.068967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:25.069131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:25.069849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:25.070156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:25.071531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:25.081734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 183/364] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:25.083137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:25.118571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:25.186949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f8595-0ec8-43c2-b58d-03ab278d333d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:25.189109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f8595-0ec8-43c2-b58d-03ab278d333d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:25.228270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68005e4-44e2-4150-93bb-254cabc8a2f1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.251296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:25.275148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e1e5c-2342-404c-af8a-8b4c3fb5475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:25.275788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1e5c-2342-404c-af8a-8b4c3fb5475c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:25.276414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1e5c-2342-404c-af8a-8b4c3fb5475c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:25.276826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1e5c-2342-404c-af8a-8b4c3fb5475c None admin] PATH_INFO: `/v3/users/29dcdfa7b12a48dc93f08ae2e1ae30b0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:25.278109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e1e5c-2342-404c-af8a-8b4c3fb5475c None admin] RBAC: Authorizing `identity:get_user(user_id=29dcdfa7b12a48dc93f08ae2e1ae30b0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:25.282872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e1e5c-2342-404c-af8a-8b4c3fb5475c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:25.284803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 184/365] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:08:25 2022] GET /identity/v3/users/29dcdfa7b12a48dc93f08ae2e1ae30b0 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:25.285836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e1e5c-2342-404c-af8a-8b4c3fb5475c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:25.327264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 182/366] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:25.328830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f8595-0ec8-43c2-b58d-03ab278d333d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:25.394279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:25.406790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e1e5c-2342-404c-af8a-8b4c3fb5475c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.440045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f8595-0ec8-43c2-b58d-03ab278d333d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.445381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5a92d-5363-438f-a066-6d70d9e0e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:25.446047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a92d-5363-438f-a066-6d70d9e0e18c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:25.446330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a92d-5363-438f-a066-6d70d9e0e18c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:25.446606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a92d-5363-438f-a066-6d70d9e0e18c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:25.458353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5a92d-5363-438f-a066-6d70d9e0e18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-50f5a92d-5363-438f-a066-6d70d9e0e18c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:25.463909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:25.465022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:25.466041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 185/367] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:08:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:25.466758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5a92d-5363-438f-a066-6d70d9e0e18c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:25.482604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325e14-b765-4f1e-a84f-57d4d6982878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:25.483485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325e14-b765-4f1e-a84f-57d4d6982878 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:25.483915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325e14-b765-4f1e-a84f-57d4d6982878 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:25.484326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325e14-b765-4f1e-a84f-57d4d6982878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:25.499943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:25.558765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325e14-b765-4f1e-a84f-57d4d6982878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:25.560478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325e14-b765-4f1e-a84f-57d4d6982878 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:25.586114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5a92d-5363-438f-a066-6d70d9e0e18c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.623403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:25.624098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:25.624384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:25.624659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:25.625500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] RBAC: Adding query filter params (role.id=42427d2d58f0468cb0d9d1d3e97617a7, user.id=29dcdfa7b12a48dc93f08ae2e1ae30b0, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:25.625839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:25.627273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:25.642153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 186/368] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Oct 6 12:08:25 2022] GET /identity/v3/role_assignments?user.id=29dcdfa7b12a48dc93f08ae2e1ae30b0&scope.system=all&role.id=42427d2d58f0468cb0d9d1d3e97617a7 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:25.646144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:25.665662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:25.671264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 183/369] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:25.672473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325e14-b765-4f1e-a84f-57d4d6982878 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:25.737822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:25.795888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cd077-c129-419b-8c28-6d159febc493 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.812422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325e14-b765-4f1e-a84f-57d4d6982878 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.837977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4affd1-8355-40ee-9156-65cc94dea4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:25.838553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4affd1-8355-40ee-9156-65cc94dea4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:25.838860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4affd1-8355-40ee-9156-65cc94dea4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:25.839112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4affd1-8355-40ee-9156-65cc94dea4a4 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:25.841435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4affd1-8355-40ee-9156-65cc94dea4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:25.843097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4affd1-8355-40ee-9156-65cc94dea4a4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:25.845106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 187/370] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:25 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:25.846017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4affd1-8355-40ee-9156-65cc94dea4a4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:25.854637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:25.855526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:25.855948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:25.856361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:25.857169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:25.857638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:25.859179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:25.869265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 184/371] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:25.870394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:25.938022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:25.966427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4affd1-8355-40ee-9156-65cc94dea4a4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.984887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9964f-d891-4ec0-acc9-f7a7e8012eab None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:25.993893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:26.004639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42cc5-64e0-434a-bbdf-332202c3c92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.005285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42cc5-64e0-434a-bbdf-332202c3c92f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.005575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42cc5-64e0-434a-bbdf-332202c3c92f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.005857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42cc5-64e0-434a-bbdf-332202c3c92f None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.007133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42cc5-64e0-434a-bbdf-332202c3c92f None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:26.008784 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42cc5-64e0-434a-bbdf-332202c3c92f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:26.010393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 188/372] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:25 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:26.011306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42cc5-64e0-434a-bbdf-332202c3c92f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:26.032983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f5f58-f149-430a-b8d1-159040a7040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.034425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f5f58-f149-430a-b8d1-159040a7040a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.034856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f5f58-f149-430a-b8d1-159040a7040a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.035307 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f5f58-f149-430a-b8d1-159040a7040a None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.037345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f5f58-f149-430a-b8d1-159040a7040a None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:26.039053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f5f58-f149-430a-b8d1-159040a7040a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:26.040872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 185/373] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:25 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:26.041811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f5f58-f149-430a-b8d1-159040a7040a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:26.128616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42cc5-64e0-434a-bbdf-332202c3c92f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:26.171346 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d354b-66c2-4f9b-bfa7-7196b1d4187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.171955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d354b-66c2-4f9b-bfa7-7196b1d4187b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.172235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d354b-66c2-4f9b-bfa7-7196b1d4187b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.172505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d354b-66c2-4f9b-bfa7-7196b1d4187b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.182678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f5f58-f149-430a-b8d1-159040a7040a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:26.189735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:26.220637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dfee2-a8ed-4392-8915-ef9533423015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.221280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dfee2-a8ed-4392-8915-ef9533423015 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.221574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dfee2-a8ed-4392-8915-ef9533423015 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.221855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dfee2-a8ed-4392-8915-ef9533423015 None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.222974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dfee2-a8ed-4392-8915-ef9533423015 None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:26.225858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dfee2-a8ed-4392-8915-ef9533423015 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:26.227496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 186/374] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:26 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:26.228276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dfee2-a8ed-4392-8915-ef9533423015 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:26.251613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d354b-66c2-4f9b-bfa7-7196b1d4187b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:26.253091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d354b-66c2-4f9b-bfa7-7196b1d4187b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:26.282138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:26.343740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dfee2-a8ed-4392-8915-ef9533423015 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:26.364511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 189/375] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:26.365382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d354b-66c2-4f9b-bfa7-7196b1d4187b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:26.381871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.382409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.382690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.382962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.383704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] RBAC: Adding query filter params (group.id=9b0abf40f3984aa48f9b53dcc7da5f08, role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=12e668dc7f0d447dbd96817dbaa612de) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:26.384014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:26.385461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:26.391822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 187/376] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:26 2022] GET /identity/v3/role_assignments?group.id=9b0abf40f3984aa48f9b53dcc7da5f08&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:26.392639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:26.421299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:26.485771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d354b-66c2-4f9b-bfa7-7196b1d4187b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:26.512632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b456812-e67c-4579-89d0-54419315e63c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:26.521548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:26.525912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.527413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.527699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.527979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.528723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] RBAC: Adding query filter params (group.id=9b0abf40f3984aa48f9b53dcc7da5f08, role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=12e668dc7f0d447dbd96817dbaa612de) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:26.529032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:26.530702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:26.537439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 190/377] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:26 2022] GET /identity/v3/role_assignments?group.id=9b0abf40f3984aa48f9b53dcc7da5f08&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:26.565884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29ddd7-9fcc-4d4f-860b-2e11c8f4a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.566560 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ddd7-9fcc-4d4f-860b-2e11c8f4a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.566841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ddd7-9fcc-4d4f-860b-2e11c8f4a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.567198 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ddd7-9fcc-4d4f-860b-2e11c8f4a1a0 None admin] PATH_INFO: `/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.573213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29ddd7-9fcc-4d4f-860b-2e11c8f4a1a0 None admin] RBAC: Authorizing `identity:get_project(project_id=9d4ef6c76dd94ad5804c0357e8bec7fc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:26.574847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29ddd7-9fcc-4d4f-860b-2e11c8f4a1a0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:26.576721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 188/378] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:26 2022] GET /identity/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:26.583506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:26.686726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75851e9-782d-4fe8-a892-91cf8f2562df None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.687024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75851e9-782d-4fe8-a892-91cf8f2562df None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.687190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75851e9-782d-4fe8-a892-91cf8f2562df None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.688704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 189/379] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:26.694706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b65e9c-200a-4db9-8233-a719c10524ad None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.695011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b65e9c-200a-4db9-8233-a719c10524ad None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.695249 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b65e9c-200a-4db9-8233-a719c10524ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.731520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a2b65e9c-200a-4db9-8233-a719c10524ad None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:26.732820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a2b65e9c-200a-4db9-8233-a719c10524ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:26.738481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf57bd-d23f-4fb3-986a-9838d5640d48 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:26.750097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:26.791189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c2696-d904-4bea-98b8-1ad30ac17a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.791835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2696-d904-4bea-98b8-1ad30ac17a62 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:26.792117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2696-d904-4bea-98b8-1ad30ac17a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:26.792423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2696-d904-4bea-98b8-1ad30ac17a62 None admin] PATH_INFO: `/v3/groups/5c188dd23c914d3d829e4ff4d1e72ca8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:26.806173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c2696-d904-4bea-98b8-1ad30ac17a62 None admin] RBAC: Authorizing `identity:get_group(group_id=5c188dd23c914d3d829e4ff4d1e72ca8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:26.806173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c2696-d904-4bea-98b8-1ad30ac17a62 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:26.806899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 191/380] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:26 2022] GET /identity/v3/groups/5c188dd23c914d3d829e4ff4d1e72ca8 => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:26.811930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c2696-d904-4bea-98b8-1ad30ac17a62 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:26.821562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 190/381] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:26.948476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c2696-d904-4bea-98b8-1ad30ac17a62 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:26.999192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:26.999818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:27.000106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:27.000380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:27.001124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] RBAC: Adding query filter params (group.id=5c188dd23c914d3d829e4ff4d1e72ca8, role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=9d4ef6c76dd94ad5804c0357e8bec7fc) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:27.001434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:27.002904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:27.014281 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 192/382] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:26 2022] GET /identity/v3/role_assignments?group.id=5c188dd23c914d3d829e4ff4d1e72ca8&scope.project.id=9d4ef6c76dd94ad5804c0357e8bec7fc&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:27.135432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b65e9c-200a-4db9-8233-a719c10524ad None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:27.294947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b65e9c-200a-4db9-8233-a719c10524ad None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:27.298343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:27.335293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ba8b1-7c8f-486c-8490-aba9d219c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:27.336311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba8b1-7c8f-486c-8490-aba9d219c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:27.336820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba8b1-7c8f-486c-8490-aba9d219c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:27.337284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ba8b1-7c8f-486c-8490-aba9d219c9b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:27.348511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ba8b1-7c8f-486c-8490-aba9d219c9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4f8ba8b1-7c8f-486c-8490-aba9d219c9b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:27.354272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:27.355172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:27.355968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:27.358584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 191/383] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:27.365491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:27.433374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:27.527679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e0f66-2736-437e-89e1-b19df2a45901 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:27.575507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdb0d8-67cc-4b68-b45a-2ba4525bd689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:27.576045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdb0d8-67cc-4b68-b45a-2ba4525bd689 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:27.576329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdb0d8-67cc-4b68-b45a-2ba4525bd689 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:27.576603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdb0d8-67cc-4b68-b45a-2ba4525bd689 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:27.577280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdb0d8-67cc-4b68-b45a-2ba4525bd689 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:27.577624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdb0d8-67cc-4b68-b45a-2ba4525bd689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:27.578987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdb0d8-67cc-4b68-b45a-2ba4525bd689 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:27.590593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 193/384] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:27.596182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ba8b1-7c8f-486c-8490-aba9d219c9b5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:27.600404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20cd23-8f1c-4b3d-8ee2-4175e768bd02 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:27.600698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20cd23-8f1c-4b3d-8ee2-4175e768bd02 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:27.600982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20cd23-8f1c-4b3d-8ee2-4175e768bd02 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:27.602748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 194/385] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:08:27.607767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc796a-3746-4952-94f2-bed01639bc73 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:27.608051 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc796a-3746-4952-94f2-bed01639bc73 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:27.608332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc796a-3746-4952-94f2-bed01639bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:27.643341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-46bc796a-3746-4952-94f2-bed01639bc73 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:27.643906 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-46bc796a-3746-4952-94f2-bed01639bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:27.758982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 195/386] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:27.767770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ba8b1-7c8f-486c-8490-aba9d219c9b5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:27.825501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e0461-88af-48b8-a49f-f90ead00430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:27.826224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e0461-88af-48b8-a49f-f90ead00430f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:27.826444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e0461-88af-48b8-a49f-f90ead00430f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:27.826715 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e0461-88af-48b8-a49f-f90ead00430f None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:27.829599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e0461-88af-48b8-a49f-f90ead00430f None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:27.831051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e0461-88af-48b8-a49f-f90ead00430f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:27.833193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 192/387] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:27 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:27.838816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc796a-3746-4952-94f2-bed01639bc73 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:27.876447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:27.985430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc796a-3746-4952-94f2-bed01639bc73 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:28.032031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5427e14-3c60-45c7-9306-7091d94033ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:28.032938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5427e14-3c60-45c7-9306-7091d94033ee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:28.033358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5427e14-3c60-45c7-9306-7091d94033ee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:28.033802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5427e14-3c60-45c7-9306-7091d94033ee None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:28.035119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5427e14-3c60-45c7-9306-7091d94033ee None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:28.037323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5427e14-3c60-45c7-9306-7091d94033ee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:28.039503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 196/388] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:27 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:28.045256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e0461-88af-48b8-a49f-f90ead00430f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:28.109986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:28.210239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e0461-88af-48b8-a49f-f90ead00430f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:28.257706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626993f-e65b-425f-bb90-9e604b76c74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:28.258382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626993f-e65b-425f-bb90-9e604b76c74d None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:28.258660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626993f-e65b-425f-bb90-9e604b76c74d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:28.258931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626993f-e65b-425f-bb90-9e604b76c74d None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/groups/9b0abf40f3984aa48f9b53dcc7da5f08/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:28.261245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626993f-e65b-425f-bb90-9e604b76c74d None admin] RBAC: Authorizing `identity:create_grant(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, group_id=9b0abf40f3984aa48f9b53dcc7da5f08, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:28.262325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5427e14-3c60-45c7-9306-7091d94033ee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:28.262716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626993f-e65b-425f-bb90-9e604b76c74d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:28.284009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 193/389] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Oct 6 12:08:28 2022] PUT /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/groups/9b0abf40f3984aa48f9b53dcc7da5f08/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:28.398450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:28.408308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5427e14-3c60-45c7-9306-7091d94033ee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:28.456489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cc939-eb9b-43b4-99fc-9e6367256101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:28.457207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cc939-eb9b-43b4-99fc-9e6367256101 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:28.457594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cc939-eb9b-43b4-99fc-9e6367256101 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:28.457870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cc939-eb9b-43b4-99fc-9e6367256101 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:28.476076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cc939-eb9b-43b4-99fc-9e6367256101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-055cc939-eb9b-43b4-99fc-9e6367256101 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:28.481033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:28.481983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:28.482814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 197/390] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:28.488296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626993f-e65b-425f-bb90-9e604b76c74d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:28.634097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:28.643567 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626993f-e65b-425f-bb90-9e604b76c74d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:28.683540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:28.684117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:28.684399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:28.684668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:28.685332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:28.685718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:28.687136 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:28.695900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 194/391] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:28.701194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cc939-eb9b-43b4-99fc-9e6367256101 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:28.809932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cc939-eb9b-43b4-99fc-9e6367256101 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:28.848368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484677d-20c0-4d9e-9126-0f1987f5f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:28.849386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484677d-20c0-4d9e-9126-0f1987f5f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:28.849865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484677d-20c0-4d9e-9126-0f1987f5f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:28.850309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484677d-20c0-4d9e-9126-0f1987f5f2c3 None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:28.851679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484677d-20c0-4d9e-9126-0f1987f5f2c3 None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:28.853305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484677d-20c0-4d9e-9126-0f1987f5f2c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:28.855476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 198/392] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:28 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:28.860806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:28.975169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390095f-f9b0-46a6-8924-7a7462aa0ba2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:29.013066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c00073-2196-4079-a9a3-5dc9c3187c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:29.014053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c00073-2196-4079-a9a3-5dc9c3187c6f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:29.014521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c00073-2196-4079-a9a3-5dc9c3187c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:29.014959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c00073-2196-4079-a9a3-5dc9c3187c6f None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:29.016264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c00073-2196-4079-a9a3-5dc9c3187c6f None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:29.018201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c00073-2196-4079-a9a3-5dc9c3187c6f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:29.020511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 195/393] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:28 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:29.025819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484677d-20c0-4d9e-9126-0f1987f5f2c3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:29.057514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:29.158124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484677d-20c0-4d9e-9126-0f1987f5f2c3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:29.200136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ace6c0-596f-4c40-9cf0-771a8d48d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:29.201129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ace6c0-596f-4c40-9cf0-771a8d48d896 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:29.201650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ace6c0-596f-4c40-9cf0-771a8d48d896 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:29.202114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ace6c0-596f-4c40-9cf0-771a8d48d896 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/groups/9b0abf40f3984aa48f9b53dcc7da5f08/roles/88a411c5f867401fb95db3c20cd8f8f1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:29.204451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ace6c0-596f-4c40-9cf0-771a8d48d896 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c, group_id=9b0abf40f3984aa48f9b53dcc7da5f08, role_id=88a411c5f867401fb95db3c20cd8f8f1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:29.206378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ace6c0-596f-4c40-9cf0-771a8d48d896 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:29.222038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 199/394] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Oct 6 12:08:29 2022] PUT /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c/groups/9b0abf40f3984aa48f9b53dcc7da5f08/roles/88a411c5f867401fb95db3c20cd8f8f1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:08:29.500497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53ab1-2635-4596-a9c0-9b34dbe873a0 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:29.501621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53ab1-2635-4596-a9c0-9b34dbe873a0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:29.502240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53ab1-2635-4596-a9c0-9b34dbe873a0 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:29.504497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 196/395] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:29.509883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b471-54ed-4b49-b467-85cb7b3c1be8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:29.510446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b471-54ed-4b49-b467-85cb7b3c1be8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:29.510913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b471-54ed-4b49-b467-85cb7b3c1be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:29.537366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18e6b471-54ed-4b49-b467-85cb7b3c1be8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:29.538994 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18e6b471-54ed-4b49-b467-85cb7b3c1be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:29.560318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65b5b-09e9-49e7-8f76-ac91edd0befa None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:29.560919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65b5b-09e9-49e7-8f76-ac91edd0befa None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:29.561381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65b5b-09e9-49e7-8f76-ac91edd0befa None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:29.563292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 197/396] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:29.569619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a02ce-6995-4340-b3a2-6908b0ce64f4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:29.570213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a02ce-6995-4340-b3a2-6908b0ce64f4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:29.570675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a02ce-6995-4340-b3a2-6908b0ce64f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:29.597237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-933a02ce-6995-4340-b3a2-6908b0ce64f4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:29.598625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-933a02ce-6995-4340-b3a2-6908b0ce64f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:29.619134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:29.675348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 200/397] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:29.705689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 198/398] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:30.081206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6b471-54ed-4b49-b467-85cb7b3c1be8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.090594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a02ce-6995-4340-b3a2-6908b0ce64f4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.101944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:30.201174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6b471-54ed-4b49-b467-85cb7b3c1be8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:30.241913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836082a-9789-4f50-8691-cca684b44714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:30.242709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836082a-9789-4f50-8691-cca684b44714 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.242991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836082a-9789-4f50-8691-cca684b44714 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.243578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836082a-9789-4f50-8691-cca684b44714 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.246878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a02ce-6995-4340-b3a2-6908b0ce64f4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:30.257048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836082a-9789-4f50-8691-cca684b44714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4836082a-9789-4f50-8691-cca684b44714 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:30.263085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:30.263983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:30.264799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:30.265950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 201/399] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:30.266576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affea2f-b6a4-4fd0-ad7a-31b4409975d0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.266858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affea2f-b6a4-4fd0-ad7a-31b4409975d0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.267132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affea2f-b6a4-4fd0-ad7a-31b4409975d0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.268667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 202/400] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:30.271756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affea2f-b6a4-4fd0-ad7a-31b4409975d0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.289659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31155c0f-5c9d-4cea-820b-2c4cb3dd54d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:30.290352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31155c0f-5c9d-4cea-820b-2c4cb3dd54d2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.290697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31155c0f-5c9d-4cea-820b-2c4cb3dd54d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.291039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31155c0f-5c9d-4cea-820b-2c4cb3dd54d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.304410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31155c0f-5c9d-4cea-820b-2c4cb3dd54d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-31155c0f-5c9d-4cea-820b-2c4cb3dd54d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:30.309391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:30.310284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:30.311574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 199/401] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:30.313224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dc279-db7f-4b82-9ea1-abf3c7526ff4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.313566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dc279-db7f-4b82-9ea1-abf3c7526ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.313905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dc279-db7f-4b82-9ea1-abf3c7526ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.332337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ec8dc279-db7f-4b82-9ea1-abf3c7526ff4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:30.334603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ec8dc279-db7f-4b82-9ea1-abf3c7526ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:30.354806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:30.360206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:30.398358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affea2f-b6a4-4fd0-ad7a-31b4409975d0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:30.410958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 200/402] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:30.411967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dc279-db7f-4b82-9ea1-abf3c7526ff4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.444393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:30.445062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.445355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.445672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.446421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:30.446730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:30.449502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:30.461077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 203/403] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:30.466765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.589767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dc279-db7f-4b82-9ea1-abf3c7526ff4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:30.651472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3c6a-c718-4a49-9241-a9e3ca906dc8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:30.679678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:30.680654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.681153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.681658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.682522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:30.683016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:30.684602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:30.694385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad331cc-6993-48d5-9e31-822d35fe5bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:30.695029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad331cc-6993-48d5-9e31-822d35fe5bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.695314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad331cc-6993-48d5-9e31-822d35fe5bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.695592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad331cc-6993-48d5-9e31-822d35fe5bf2 None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.697655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad331cc-6993-48d5-9e31-822d35fe5bf2 None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:30.699235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad331cc-6993-48d5-9e31-822d35fe5bf2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:30.700993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 204/404] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:30.702939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad331cc-6993-48d5-9e31-822d35fe5bf2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.705932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 201/405] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:30.706722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.710943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:30.713918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:30.818868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad331cc-6993-48d5-9e31-822d35fe5bf2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:30.853901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdfde0-8b46-40d3-b8dd-de8d147d184b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:30.854976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6ea2-31c7-4a25-bebb-c6e9664a7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:30.855621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6ea2-31c7-4a25-bebb-c6e9664a7308 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.855909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6ea2-31c7-4a25-bebb-c6e9664a7308 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.856189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6ea2-31c7-4a25-bebb-c6e9664a7308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.867785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d6ea2-31c7-4a25-bebb-c6e9664a7308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-856d6ea2-31c7-4a25-bebb-c6e9664a7308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:30.873084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:30.874021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 205/406] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:30.875205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6ea2-31c7-4a25-bebb-c6e9664a7308 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.908251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7ee5-8cdc-494b-bc40-c7144e82762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:30.908876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7ee5-8cdc-494b-bc40-c7144e82762c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:30.909353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7ee5-8cdc-494b-bc40-c7144e82762c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:30.909670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7ee5-8cdc-494b-bc40-c7144e82762c None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:30.911360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c7ee5-8cdc-494b-bc40-c7144e82762c None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:30.913406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c7ee5-8cdc-494b-bc40-c7144e82762c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:30.920455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 202/407] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:30.920455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7ee5-8cdc-494b-bc40-c7144e82762c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:30.953645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:30.998034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6ea2-31c7-4a25-bebb-c6e9664a7308 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:31.015513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:31.039457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2d62f-d96e-4f6a-a66c-d48001a53245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:31.040527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d62f-d96e-4f6a-a66c-d48001a53245 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.041007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d62f-d96e-4f6a-a66c-d48001a53245 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.041506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d62f-d96e-4f6a-a66c-d48001a53245 None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.042954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2d62f-d96e-4f6a-a66c-d48001a53245 None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:31.044724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2d62f-d96e-4f6a-a66c-d48001a53245 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:31.046720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 206/408] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:31.047654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2d62f-d96e-4f6a-a66c-d48001a53245 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:31.054108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7ee5-8cdc-494b-bc40-c7144e82762c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:31.105602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:31.106540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.107014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.107505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.108364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:31.108924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:31.110583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:31.120303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 203/409] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:31.121648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:31.182592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2d62f-d96e-4f6a-a66c-d48001a53245 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:31.220944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:31.229705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f8d94-7a13-4d58-bdc8-a1e1cc3f3a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:31.230375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f8d94-7a13-4d58-bdc8-a1e1cc3f3a8c None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.230658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f8d94-7a13-4d58-bdc8-a1e1cc3f3a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.230941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f8d94-7a13-4d58-bdc8-a1e1cc3f3a8c None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de/groups/9b0abf40f3984aa48f9b53dcc7da5f08/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.233678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f8d94-7a13-4d58-bdc8-a1e1cc3f3a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=12e668dc7f0d447dbd96817dbaa612de, group_id=9b0abf40f3984aa48f9b53dcc7da5f08, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:31.235284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f8d94-7a13-4d58-bdc8-a1e1cc3f3a8c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:31.242939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc7398-973b-4250-b770-ea226df74156 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:31.257600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 207/410] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Oct 6 12:08:31 2022] PUT /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de/groups/9b0abf40f3984aa48f9b53dcc7da5f08/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:31.257600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f8d94-7a13-4d58-bdc8-a1e1cc3f3a8c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:31.301674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea590e3-f5ea-4904-a3d1-fe1652944aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:31.302333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea590e3-f5ea-4904-a3d1-fe1652944aab None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.302839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea590e3-f5ea-4904-a3d1-fe1652944aab None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.303178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea590e3-f5ea-4904-a3d1-fe1652944aab None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.304347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea590e3-f5ea-4904-a3d1-fe1652944aab None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:31.305845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea590e3-f5ea-4904-a3d1-fe1652944aab None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:31.307665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 204/411] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:31 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:31.308958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4035303-a9b1-48ea-bc37-536cc7265353 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.309244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4035303-a9b1-48ea-bc37-536cc7265353 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.309521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4035303-a9b1-48ea-bc37-536cc7265353 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.315372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 205/412] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:31.316317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4035303-a9b1-48ea-bc37-536cc7265353 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:31.320047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:31.391977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f8d94-7a13-4d58-bdc8-a1e1cc3f3a8c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:31.441433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f4fe7-75d4-477f-86b1-c3771457ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:31.442657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4fe7-75d4-477f-86b1-c3771457ab2f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.443092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4fe7-75d4-477f-86b1-c3771457ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.443368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f4fe7-75d4-477f-86b1-c3771457ab2f None admin] PATH_INFO: `/v3/groups/5c188dd23c914d3d829e4ff4d1e72ca8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.444293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4035303-a9b1-48ea-bc37-536cc7265353 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:31.444512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f4fe7-75d4-477f-86b1-c3771457ab2f None admin] RBAC: Authorizing `identity:get_group(group_id=5c188dd23c914d3d829e4ff4d1e72ca8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:31.446234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f4fe7-75d4-477f-86b1-c3771457ab2f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:31.448907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 208/413] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:31 2022] GET /identity/v3/groups/5c188dd23c914d3d829e4ff4d1e72ca8 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:31.449945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540373d8-3e84-421f-b0d0-d2cb6996ebef None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.450228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540373d8-3e84-421f-b0d0-d2cb6996ebef None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.450499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540373d8-3e84-421f-b0d0-d2cb6996ebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.472309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-540373d8-3e84-421f-b0d0-d2cb6996ebef None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:31.474912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-540373d8-3e84-421f-b0d0-d2cb6996ebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:31.497160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e9f96-2d2c-4da9-840f-45038aa98f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:31.497883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e9f96-2d2c-4da9-840f-45038aa98f25 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.498166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e9f96-2d2c-4da9-840f-45038aa98f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.498442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e9f96-2d2c-4da9-840f-45038aa98f25 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de/groups/9b0abf40f3984aa48f9b53dcc7da5f08/roles/88a411c5f867401fb95db3c20cd8f8f1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.501082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e9f96-2d2c-4da9-840f-45038aa98f25 None admin] RBAC: Authorizing `identity:create_grant(project_id=12e668dc7f0d447dbd96817dbaa612de, group_id=9b0abf40f3984aa48f9b53dcc7da5f08, role_id=88a411c5f867401fb95db3c20cd8f8f1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:31.502353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e9f96-2d2c-4da9-840f-45038aa98f25 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:31.520323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 206/414] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Oct 6 12:08:31 2022] PUT /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de/groups/9b0abf40f3984aa48f9b53dcc7da5f08/roles/88a411c5f867401fb95db3c20cd8f8f1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:31.521490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e9f96-2d2c-4da9-840f-45038aa98f25 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:31.547297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:31.578676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 209/415] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:31.616603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:31.671578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e9f96-2d2c-4da9-840f-45038aa98f25 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:31.721713 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e514-76a0-496f-883a-6ca2ec09f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:31.722360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e514-76a0-496f-883a-6ca2ec09f23f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.722642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e514-76a0-496f-883a-6ca2ec09f23f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.723242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e514-76a0-496f-883a-6ca2ec09f23f None admin] PATH_INFO: `/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.724141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e514-76a0-496f-883a-6ca2ec09f23f None admin] RBAC: Authorizing `identity:get_project(project_id=9d4ef6c76dd94ad5804c0357e8bec7fc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:31.725695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e514-76a0-496f-883a-6ca2ec09f23f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:31.727634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 207/416] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:31 2022] GET /identity/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:31.732994 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540373d8-3e84-421f-b0d0-d2cb6996ebef None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:31.850830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540373d8-3e84-421f-b0d0-d2cb6996ebef None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:31.904279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8d943-d294-449b-b436-1068b2c1df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:31.904997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8d943-d294-449b-b436-1068b2c1df35 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.905284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8d943-d294-449b-b436-1068b2c1df35 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.905575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8d943-d294-449b-b436-1068b2c1df35 None admin] PATH_INFO: `/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc/groups/5c188dd23c914d3d829e4ff4d1e72ca8/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.911222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8d943-d294-449b-b436-1068b2c1df35 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d4ef6c76dd94ad5804c0357e8bec7fc, group_id=5c188dd23c914d3d829e4ff4d1e72ca8, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:31.912763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8d943-d294-449b-b436-1068b2c1df35 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:31.937497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 210/417] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Oct 6 12:08:31 2022] PUT /identity/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc/groups/5c188dd23c914d3d829e4ff4d1e72ca8/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:31.940197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eb343-066e-4815-922a-c85cae5f6344 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.940547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eb343-066e-4815-922a-c85cae5f6344 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.940831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eb343-066e-4815-922a-c85cae5f6344 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.943225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 208/418] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:31.949090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a87bf-77a9-4bf2-a216-36c073fe84a4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:31.949377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a87bf-77a9-4bf2-a216-36c073fe84a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:31.949680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a87bf-77a9-4bf2-a216-36c073fe84a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:31.969260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f43a87bf-77a9-4bf2-a216-36c073fe84a4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:31.970581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f43a87bf-77a9-4bf2-a216-36c073fe84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:32.026783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eb343-066e-4815-922a-c85cae5f6344 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:32.048505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:32.082612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 211/419] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:32.210869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eb343-066e-4815-922a-c85cae5f6344 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:32.244280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:32.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623894b-f0c6-4e10-98e9-8d3332b24470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:32.251395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623894b-f0c6-4e10-98e9-8d3332b24470 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:32.251682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623894b-f0c6-4e10-98e9-8d3332b24470 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:32.252045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623894b-f0c6-4e10-98e9-8d3332b24470 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:32.267465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623894b-f0c6-4e10-98e9-8d3332b24470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6623894b-f0c6-4e10-98e9-8d3332b24470 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:32.273018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:32.273933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:32.274720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 209/420] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:32.280276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a87bf-77a9-4bf2-a216-36c073fe84a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:32.385428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623894b-f0c6-4e10-98e9-8d3332b24470 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:32.397043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a87bf-77a9-4bf2-a216-36c073fe84a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:32.441122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:32.442498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:32.442776 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:32.445952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:32.446543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:32.447820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:32.449211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:32.470549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 212/421] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:32.477305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:32.540078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623894b-f0c6-4e10-98e9-8d3332b24470 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:32.568257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:32.615855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0cf18-c566-4719-b740-b681cf97ace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:32.616506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0cf18-c566-4719-b740-b681cf97ace6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:32.616785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0cf18-c566-4719-b740-b681cf97ace6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:32.617310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0cf18-c566-4719-b740-b681cf97ace6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:32.642015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4754980-262c-414f-8b07-7ddf2d812f1f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:32.650499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0cf18-c566-4719-b740-b681cf97ace6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-72e0cf18-c566-4719-b740-b681cf97ace6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:32.656324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:32.657247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:32.658076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:32.666015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 210/422] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:32.671507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0cf18-c566-4719-b740-b681cf97ace6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:32.683822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac524c-13b4-4682-81d3-928305aea3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:32.684438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac524c-13b4-4682-81d3-928305aea3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:32.684717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac524c-13b4-4682-81d3-928305aea3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:32.684988 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac524c-13b4-4682-81d3-928305aea3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:32.772133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac524c-13b4-4682-81d3-928305aea3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:32.773731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:32.774562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac524c-13b4-4682-81d3-928305aea3d9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:32.822292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:32.867817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0cf18-c566-4719-b740-b681cf97ace6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:32.880190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 213/423] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 12:08:32.886741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac524c-13b4-4682-81d3-928305aea3d9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:32.938794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:32.939792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:32.940291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:32.940758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:32.941668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:32.944239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:32.945872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:32.966258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 211/424] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:32.971514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:33.097492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac524c-13b4-4682-81d3-928305aea3d9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:33.146363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f5065-68f9-47ab-9e2c-63b16e612de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:33.147383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5065-68f9-47ab-9e2c-63b16e612de0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:33.147861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5065-68f9-47ab-9e2c-63b16e612de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:33.148331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5065-68f9-47ab-9e2c-63b16e612de0 None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:33.150699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f5065-68f9-47ab-9e2c-63b16e612de0 None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:33.152622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f5065-68f9-47ab-9e2c-63b16e612de0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:33.156248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 214/425] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:32 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:33.158630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c144949-3357-48e6-8170-7a6d8628ebe1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:33.161436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f5065-68f9-47ab-9e2c-63b16e612de0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:33.183852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:33.189419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:33.237281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fecc93-d064-4686-ad5f-720b22673d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:33.237953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fecc93-d064-4686-ad5f-720b22673d32 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:33.238236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fecc93-d064-4686-ad5f-720b22673d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:33.239054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fecc93-d064-4686-ad5f-720b22673d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:33.354372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f5065-68f9-47ab-9e2c-63b16e612de0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:33.383609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fecc93-d064-4686-ad5f-720b22673d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:33.385067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fecc93-d064-4686-ad5f-720b22673d32 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:33.395553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983f73-e14d-4055-a844-e99ef95e2e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:33.396197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983f73-e14d-4055-a844-e99ef95e2e4b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:33.396484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983f73-e14d-4055-a844-e99ef95e2e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:33.396761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983f73-e14d-4055-a844-e99ef95e2e4b None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:33.398140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983f73-e14d-4055-a844-e99ef95e2e4b None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:33.399596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983f73-e14d-4055-a844-e99ef95e2e4b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:33.406983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 215/426] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:33 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:33.408781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983f73-e14d-4055-a844-e99ef95e2e4b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:33.522570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983f73-e14d-4055-a844-e99ef95e2e4b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:33.526213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:33.564581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:33.565211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:33.565504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:33.565840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:33.566601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] RBAC: Adding query filter params (group.id=9b0abf40f3984aa48f9b53dcc7da5f08, role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:33.567468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:33.568982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:33.582128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 216/427] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:33 2022] GET /identity/v3/role_assignments?group.id=9b0abf40f3984aa48f9b53dcc7da5f08&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:33.676948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 212/428] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 12:08:33.682957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:33.707365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290e0a-5c47-4af8-94fe-8505c0760a5f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:33.707718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290e0a-5c47-4af8-94fe-8505c0760a5f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:33.707953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290e0a-5c47-4af8-94fe-8505c0760a5f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:33.709741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 213/429] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:08:33.715666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692d12-9e0e-4390-a611-c9805ffe4178 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:33.716281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692d12-9e0e-4390-a611-c9805ffe4178 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:33.716771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692d12-9e0e-4390-a611-c9805ffe4178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:33.756120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-bf692d12-9e0e-4390-a611-c9805ffe4178 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:33.757379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bf692d12-9e0e-4390-a611-c9805ffe4178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:33.772652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:33.860644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9970a-851d-42df-b918-1d59ad5fc384 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:33.871895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 214/430] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:33.906261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feb552-9a51-466a-9f99-295d96b1c05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:33.907251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb552-9a51-466a-9f99-295d96b1c05e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:33.907787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb552-9a51-466a-9f99-295d96b1c05e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:33.908304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb552-9a51-466a-9f99-295d96b1c05e None admin] PATH_INFO: `/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:33.910074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feb552-9a51-466a-9f99-295d96b1c05e None admin] RBAC: Authorizing `identity:get_project(project_id=2d3b3f8c7c324bf792fd1ac05d6dfb0c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:33.913671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feb552-9a51-466a-9f99-295d96b1c05e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:33.915856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 217/431] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:33 2022] GET /identity/v3/projects/2d3b3f8c7c324bf792fd1ac05d6dfb0c => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:33.921562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf692d12-9e0e-4390-a611-c9805ffe4178 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:34.044146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf692d12-9e0e-4390-a611-c9805ffe4178 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:34.086559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c9d8-22a7-4ac8-9fd2-eb185fc05320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:34.087206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c9d8-22a7-4ac8-9fd2-eb185fc05320 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.087487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c9d8-22a7-4ac8-9fd2-eb185fc05320 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.087764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c9d8-22a7-4ac8-9fd2-eb185fc05320 None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.090705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c9d8-22a7-4ac8-9fd2-eb185fc05320 None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:34.092217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c9d8-22a7-4ac8-9fd2-eb185fc05320 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:34.094282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 215/432] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:33 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:34.100441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feb552-9a51-466a-9f99-295d96b1c05e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:34.118362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:34.165662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c9d8-22a7-4ac8-9fd2-eb185fc05320 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:34.179277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:34.244844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feb552-9a51-466a-9f99-295d96b1c05e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:34.286643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ed735-ae05-4f7e-be85-5121bf0b1f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:34.287297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed735-ae05-4f7e-be85-5121bf0b1f39 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.287582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed735-ae05-4f7e-be85-5121bf0b1f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.287858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed735-ae05-4f7e-be85-5121bf0b1f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.288603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ed735-ae05-4f7e-be85-5121bf0b1f39 None admin] RBAC: Adding query filter params (group.id=9b0abf40f3984aa48f9b53dcc7da5f08, role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:34.288923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ed735-ae05-4f7e-be85-5121bf0b1f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:34.290421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ed735-ae05-4f7e-be85-5121bf0b1f39 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:34.294879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c9d8-22a7-4ac8-9fd2-eb185fc05320 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:34.296704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 218/433] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:34 2022] GET /identity/v3/role_assignments?group.id=9b0abf40f3984aa48f9b53dcc7da5f08&scope.project.id=2d3b3f8c7c324bf792fd1ac05d6dfb0c&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:34.297824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c796-fe94-42fc-8056-2f8e45961bbd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.298809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c796-fe94-42fc-8056-2f8e45961bbd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.298809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c796-fe94-42fc-8056-2f8e45961bbd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.300200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 219/434] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:34.307401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c113d-ccda-4769-9154-77b51fc94409 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.307707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c113d-ccda-4769-9154-77b51fc94409 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.307966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c113d-ccda-4769-9154-77b51fc94409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.329128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-358c113d-ccda-4769-9154-77b51fc94409 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:34.331681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-358c113d-ccda-4769-9154-77b51fc94409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:34.339446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2599585-2717-4ba2-852a-a2e4b50f70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:34.340246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599585-2717-4ba2-852a-a2e4b50f70b9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.340622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599585-2717-4ba2-852a-a2e4b50f70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.340955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599585-2717-4ba2-852a-a2e4b50f70b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.364126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2599585-2717-4ba2-852a-a2e4b50f70b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c2599585-2717-4ba2-852a-a2e4b50f70b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:34.370484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:34.371485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:34.372279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 216/435] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:34.380333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2599585-2717-4ba2-852a-a2e4b50f70b9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:34.427828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 220/436] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:34.469156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:34.503996 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2599585-2717-4ba2-852a-a2e4b50f70b9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:34.541264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fdd19f-7cd5-44a6-b025-073495ce8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:34.541899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdd19f-7cd5-44a6-b025-073495ce8b1e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.542176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdd19f-7cd5-44a6-b025-073495ce8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.542446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdd19f-7cd5-44a6-b025-073495ce8b1e None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.543112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdd19f-7cd5-44a6-b025-073495ce8b1e None admin] RBAC: Adding query filter params (name=member) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:34.543411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdd19f-7cd5-44a6-b025-073495ce8b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:34.544787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdd19f-7cd5-44a6-b025-073495ce8b1e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:34.554784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 217/437] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:08:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:34.560474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c113d-ccda-4769-9154-77b51fc94409 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:34.565127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:34.677846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c113d-ccda-4769-9154-77b51fc94409 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:34.716025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d8302-df90-4301-a1e4-0901d28bb718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:34.716643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d8302-df90-4301-a1e4-0901d28bb718 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.716918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d8302-df90-4301-a1e4-0901d28bb718 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.717188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d8302-df90-4301-a1e4-0901d28bb718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.749854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048222b-f13c-4b9d-aeec-39297de170fd None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.750358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048222b-f13c-4b9d-aeec-39297de170fd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.750440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048222b-f13c-4b9d-aeec-39297de170fd None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.751724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 218/438] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:08:34.752435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048222b-f13c-4b9d-aeec-39297de170fd None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:34.795535 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d8302-df90-4301-a1e4-0901d28bb718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:34.797277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d8302-df90-4301-a1e4-0901d28bb718 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:34.801726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:34.875305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048222b-f13c-4b9d-aeec-39297de170fd None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:34.904312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:34.904731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 221/439] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:34.906805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24090672-ee7e-4116-96ef-7f78080f2c0c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.907268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24090672-ee7e-4116-96ef-7f78080f2c0c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.907694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24090672-ee7e-4116-96ef-7f78080f2c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.909759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b125a68-246f-42ba-bfd9-5f72c9b07b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:34.910994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b125a68-246f-42ba-bfd9-5f72c9b07b0c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:34.911612 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b125a68-246f-42ba-bfd9-5f72c9b07b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:34.912237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b125a68-246f-42ba-bfd9-5f72c9b07b0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:34.923133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b125a68-246f-42ba-bfd9-5f72c9b07b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:34.927551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-24090672-ee7e-4116-96ef-7f78080f2c0c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-2b125a68-246f-42ba-bfd9-5f72c9b07b0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:34.928182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:34.929224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:34.930498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:34.931310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-24090672-ee7e-4116-96ef-7f78080f2c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:34.931409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 219/440] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:34.931409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b125a68-246f-42ba-bfd9-5f72c9b07b0c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:34.997968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 222/441] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:34.998817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24090672-ee7e-4116-96ef-7f78080f2c0c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.040540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:35.043170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b125a68-246f-42ba-bfd9-5f72c9b07b0c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.083413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb557d-1fba-4380-96e2-f38a6af71fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.084152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb557d-1fba-4380-96e2-f38a6af71fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.084442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb557d-1fba-4380-96e2-f38a6af71fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.084722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb557d-1fba-4380-96e2-f38a6af71fb8 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.085911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb557d-1fba-4380-96e2-f38a6af71fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:35.087370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb557d-1fba-4380-96e2-f38a6af71fb8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:35.089574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 220/442] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:34 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:35.094361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb557d-1fba-4380-96e2-f38a6af71fb8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.118650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24090672-ee7e-4116-96ef-7f78080f2c0c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.157025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.157961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.158743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.159040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.159712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:35.160014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:35.161564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:35.169315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:35.173107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 223/443] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:35.179833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.218528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb557d-1fba-4380-96e2-f38a6af71fb8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.257177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5f69-b442-4803-9772-9b4a628a939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.257846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5f69-b442-4803-9772-9b4a628a939d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.258125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5f69-b442-4803-9772-9b4a628a939d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.258398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5f69-b442-4803-9772-9b4a628a939d None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.259524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5f69-b442-4803-9772-9b4a628a939d None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:35.260979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5f69-b442-4803-9772-9b4a628a939d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:35.262973 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 221/444] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:35.268324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5f69-b442-4803-9772-9b4a628a939d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.288271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:35.296084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba5e28-b432-431b-9bc0-95395501bd51 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.338018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d96557-16c0-4ac8-b985-7055d44c77de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.338623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96557-16c0-4ac8-b985-7055d44c77de None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.338929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96557-16c0-4ac8-b985-7055d44c77de None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.339200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d96557-16c0-4ac8-b985-7055d44c77de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.382138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5f69-b442-4803-9772-9b4a628a939d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.408621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d96557-16c0-4ac8-b985-7055d44c77de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:35.410135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d96557-16c0-4ac8-b985-7055d44c77de None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:35.411963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:35.420471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.421179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.421548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.421844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.422580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] RBAC: Adding query filter params (group.id=9b0abf40f3984aa48f9b53dcc7da5f08, role.id=d33de683560f4a1d95bcd204be71dc4f, scope.project.id=12e668dc7f0d447dbd96817dbaa612de) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:35.422892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:35.424330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:35.431159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 222/445] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/role_assignments?group.id=9b0abf40f3984aa48f9b53dcc7da5f08&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=d33de683560f4a1d95bcd204be71dc4f => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:35.431963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.533428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:35.546424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 224/446] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 12:08:35.547667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d96557-16c0-4ac8-b985-7055d44c77de None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.551833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece53d-704c-472e-b103-2bbd81974b34 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.605726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec529f7-a880-4f3f-8809-09f0cab1d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.606403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec529f7-a880-4f3f-8809-09f0cab1d6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.606690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec529f7-a880-4f3f-8809-09f0cab1d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.606972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec529f7-a880-4f3f-8809-09f0cab1d6b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.620133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec529f7-a880-4f3f-8809-09f0cab1d6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-0ec529f7-a880-4f3f-8809-09f0cab1d6b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:35.625621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:35.626541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:35.627335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 223/447] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:35.636433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec529f7-a880-4f3f-8809-09f0cab1d6b2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.687573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d96557-16c0-4ac8-b985-7055d44c77de None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.711606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:35.738206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42a99-4752-4ef8-bcdb-df21ea7d3d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.739450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42a99-4752-4ef8-bcdb-df21ea7d3d03 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.740040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42a99-4752-4ef8-bcdb-df21ea7d3d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.740040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42a99-4752-4ef8-bcdb-df21ea7d3d03 None admin] PATH_INFO: `/v3/projects/12e668dc7f0d447dbd96817dbaa612de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.741163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d42a99-4752-4ef8-bcdb-df21ea7d3d03 None admin] RBAC: Authorizing `identity:get_project(project_id=12e668dc7f0d447dbd96817dbaa612de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:35.742678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d42a99-4752-4ef8-bcdb-df21ea7d3d03 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:35.745199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 225/448] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/projects/12e668dc7f0d447dbd96817dbaa612de => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:35.750056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42a99-4752-4ef8-bcdb-df21ea7d3d03 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.779207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec529f7-a880-4f3f-8809-09f0cab1d6b2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.829483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.830274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.830641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.830795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.831542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:35.831846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:35.831957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:35.834507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:35.849624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 224/449] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:35.852298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.886915 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42a99-4752-4ef8-bcdb-df21ea7d3d03 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.922540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7d03d-c89e-4c39-a227-e6f9877f8a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.923187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d03d-c89e-4c39-a227-e6f9877f8a7e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:35.923483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d03d-c89e-4c39-a227-e6f9877f8a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:35.923756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d03d-c89e-4c39-a227-e6f9877f8a7e None admin] PATH_INFO: `/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:35.924914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7d03d-c89e-4c39-a227-e6f9877f8a7e None admin] RBAC: Authorizing `identity:get_group(group_id=9b0abf40f3984aa48f9b53dcc7da5f08)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:35.926869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7d03d-c89e-4c39-a227-e6f9877f8a7e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:35.928586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 226/450] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/groups/9b0abf40f3984aa48f9b53dcc7da5f08 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:35.934695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7d03d-c89e-4c39-a227-e6f9877f8a7e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:35.960429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15147e32-5fa3-4271-bab6-a78e853a6962 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:35.975287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:35.999306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849afda2-e892-48e0-9da2-1a92b71e7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:35.999931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849afda2-e892-48e0-9da2-1a92b71e7df5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:36.000215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849afda2-e892-48e0-9da2-1a92b71e7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:36.000491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849afda2-e892-48e0-9da2-1a92b71e7df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:36.040159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7d03d-c89e-4c39-a227-e6f9877f8a7e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:36.071301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:36.075099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849afda2-e892-48e0-9da2-1a92b71e7df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:36.076609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849afda2-e892-48e0-9da2-1a92b71e7df5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:36.076909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:36.077560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:36.077919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:36.078197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:36.078940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] RBAC: Adding query filter params (group.id=9b0abf40f3984aa48f9b53dcc7da5f08, role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=12e668dc7f0d447dbd96817dbaa612de) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:36.079249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:36.080691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:36.087597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 227/451] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/role_assignments?group.id=9b0abf40f3984aa48f9b53dcc7da5f08&scope.project.id=12e668dc7f0d447dbd96817dbaa612de&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:36.197970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 225/452] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 06 12:08:36.203932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:36.314603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b25e6e-7554-49c9-8122-b80c5954e60b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:36.352801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623b0c6-11e4-4d4f-95fa-09d30dffe123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:36.353450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623b0c6-11e4-4d4f-95fa-09d30dffe123 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:36.353764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623b0c6-11e4-4d4f-95fa-09d30dffe123 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:36.354040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623b0c6-11e4-4d4f-95fa-09d30dffe123 None admin] PATH_INFO: `/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:36.355250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623b0c6-11e4-4d4f-95fa-09d30dffe123 None admin] RBAC: Authorizing `identity:get_project(project_id=9d4ef6c76dd94ad5804c0357e8bec7fc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:36.356721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623b0c6-11e4-4d4f-95fa-09d30dffe123 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:36.358450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 228/453] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:08:36 2022] GET /identity/v3/projects/9d4ef6c76dd94ad5804c0357e8bec7fc => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:36.364291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849afda2-e892-48e0-9da2-1a92b71e7df5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:36.380285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:36.478110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849afda2-e892-48e0-9da2-1a92b71e7df5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:36.514752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407ece-f65e-49f8-b015-c2f7956dffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:36.515421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407ece-f65e-49f8-b015-c2f7956dffdc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:36.515701 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407ece-f65e-49f8-b015-c2f7956dffdc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:36.515974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407ece-f65e-49f8-b015-c2f7956dffdc None admin] PATH_INFO: `/v3/groups/5c188dd23c914d3d829e4ff4d1e72ca8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:36.517103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407ece-f65e-49f8-b015-c2f7956dffdc None admin] RBAC: Authorizing `identity:get_group(group_id=5c188dd23c914d3d829e4ff4d1e72ca8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:36.518615 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407ece-f65e-49f8-b015-c2f7956dffdc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:36.520770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 226/454] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Oct 6 12:08:36 2022] GET /identity/v3/groups/5c188dd23c914d3d829e4ff4d1e72ca8 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:36.527094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623b0c6-11e4-4d4f-95fa-09d30dffe123 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:36.591527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:36.632363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623b0c6-11e4-4d4f-95fa-09d30dffe123 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:36.668353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb704895-bcb9-435c-80d7-9404a41ac974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:36.668964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704895-bcb9-435c-80d7-9404a41ac974 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:36.669245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704895-bcb9-435c-80d7-9404a41ac974 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:36.669515 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704895-bcb9-435c-80d7-9404a41ac974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:36.670289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb704895-bcb9-435c-80d7-9404a41ac974 None admin] RBAC: Adding query filter params (group.id=5c188dd23c914d3d829e4ff4d1e72ca8, role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=9d4ef6c76dd94ad5804c0357e8bec7fc) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:36.670599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb704895-bcb9-435c-80d7-9404a41ac974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:36.672028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb704895-bcb9-435c-80d7-9404a41ac974 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:36.678873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 229/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Oct 6 12:08:36 2022] GET /identity/v3/role_assignments?group.id=5c188dd23c914d3d829e4ff4d1e72ca8&scope.project.id=9d4ef6c76dd94ad5804c0357e8bec7fc&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:39.611525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dfbb8-7e39-42ed-994a-bab45bc6a6c3 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:39.612683 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dfbb8-7e39-42ed-994a-bab45bc6a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:39.613332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dfbb8-7e39-42ed-994a-bab45bc6a6c3 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:39.615340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 227/456] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:39.621430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9decb50-f002-4bda-8694-bb224ae2a0b9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:39.622667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9decb50-f002-4bda-8694-bb224ae2a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:39.623398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9decb50-f002-4bda-8694-bb224ae2a0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:39.654712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b9decb50-f002-4bda-8694-bb224ae2a0b9 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:39.656260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9decb50-f002-4bda-8694-bb224ae2a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:39.766834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 230/457] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:39.826085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb148f-b95b-4fc1-91cf-302844fc22da None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:39.826960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb148f-b95b-4fc1-91cf-302844fc22da None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:39.827693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb148f-b95b-4fc1-91cf-302844fc22da None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:39.830241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 228/458] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:39.836213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a96d8b-3926-4bf6-8c79-4e9e1e06a70a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:39.836536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a96d8b-3926-4bf6-8c79-4e9e1e06a70a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:39.836771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a96d8b-3926-4bf6-8c79-4e9e1e06a70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:39.866741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-78a96d8b-3926-4bf6-8c79-4e9e1e06a70a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:39.867862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-78a96d8b-3926-4bf6-8c79-4e9e1e06a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:39.939062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:39.948121 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa87f31-a1d1-44fb-b78c-e4e1d9e88a6b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:39.948752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa87f31-a1d1-44fb-b78c-e4e1d9e88a6b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:39.949222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa87f31-a1d1-44fb-b78c-e4e1d9e88a6b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:39.951048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 229/459] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:39.957485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e81e-73b4-4fe6-aa4c-5f82604f4226 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:39.958261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e81e-73b4-4fe6-aa4c-5f82604f4226 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:39.958969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e81e-73b4-4fe6-aa4c-5f82604f4226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:39.959074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 231/460] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:40.002549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c733e81e-73b4-4fe6-aa4c-5f82604f4226 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:40.004022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c733e81e-73b4-4fe6-aa4c-5f82604f4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:40.119288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 230/461] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:40.216083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a96d8b-3926-4bf6-8c79-4e9e1e06a70a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:40.342155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a96d8b-3926-4bf6-8c79-4e9e1e06a70a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:40.388660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:40.389314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:40.389620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:40.389897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:40.399932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e81e-73b4-4fe6-aa4c-5f82604f4226 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:40.406042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:40.408054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:40.429941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:40.440256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:40.441790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:40.442708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:40.442708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:40.442708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:40.443092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 232/462] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:40.451043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:40.498754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:40.554002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e81e-73b4-4fe6-aa4c-5f82604f4226 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:40.573496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee099de-3720-4b00-bbc9-a764c8d727d0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:40.596966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:40.598334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:40.598768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:40.599229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:40.610203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:40.611679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:40.612240 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f8cef-d60f-4947-828d-7c6a0567feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:40.612482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f8cef-d60f-4947-828d-7c6a0567feaa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:40.612691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f8cef-d60f-4947-828d-7c6a0567feaa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:40.612963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f8cef-d60f-4947-828d-7c6a0567feaa None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:40.614432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f8cef-d60f-4947-828d-7c6a0567feaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:40.614902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f8cef-d60f-4947-828d-7c6a0567feaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:40.616255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f8cef-d60f-4947-828d-7c6a0567feaa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:40.628838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:40.630536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:40.631376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:40.631376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:40.631376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:40.631376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 231/463] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:40.631602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:40.637783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 233/464] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:40.639719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6aec-f3c8-457d-8f96-aa88fa1d782a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:40.640205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6aec-f3c8-457d-8f96-aa88fa1d782a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:40.641237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa6aec-f3c8-457d-8f96-aa88fa1d782a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:40.646856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 234/465] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:40.646856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa6aec-f3c8-457d-8f96-aa88fa1d782a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:40.700995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:40.742787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731260e-6d9f-4b05-8ef7-0feb31d11841 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:40.756268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:40.761007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa6aec-f3c8-457d-8f96-aa88fa1d782a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:40.780107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:40.780738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:40.781014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:40.781290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:40.793786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:40.795249 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:40.801801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c7409-929a-4202-916d-beff7e576054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:40.802769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7409-929a-4202-916d-beff7e576054 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:40.803062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7409-929a-4202-916d-beff7e576054 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:40.803425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7409-929a-4202-916d-beff7e576054 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:40.804113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c7409-929a-4202-916d-beff7e576054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:40.804465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c7409-929a-4202-916d-beff7e576054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:40.806080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c7409-929a-4202-916d-beff7e576054 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:40.813143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:40.814084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:40.821012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:40.821012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:40.821012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:40.821012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 232/466] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:40.821012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:40.827733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 235/467] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:40.833070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069575f-0d64-4bb4-b883-655baf52403f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:40.833070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069575f-0d64-4bb4-b883-655baf52403f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:40.833070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069575f-0d64-4bb4-b883-655baf52403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:40.848232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e069575f-0d64-4bb4-b883-655baf52403f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:40.849435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e069575f-0d64-4bb4-b883-655baf52403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:40.922574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 236/468] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:40.923152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069575f-0d64-4bb4-b883-655baf52403f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:40.947705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbe1b8-1429-4c1c-89a6-43368940ce3b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:40.965382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:40.987210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15c47e-426e-47ee-91bc-72792d4e7c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:40.987856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15c47e-426e-47ee-91bc-72792d4e7c27 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:40.988138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15c47e-426e-47ee-91bc-72792d4e7c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:40.988947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15c47e-426e-47ee-91bc-72792d4e7c27 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:40.990157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15c47e-426e-47ee-91bc-72792d4e7c27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:40.991753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15c47e-426e-47ee-91bc-72792d4e7c27 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:41.025580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 233/469] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:08:40 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:41.025580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15c47e-426e-47ee-91bc-72792d4e7c27 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:41.063220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:41.086989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069575f-0d64-4bb4-b883-655baf52403f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:41.132633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592686b-cd6d-440a-a527-2fe86e985a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:41.133467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592686b-cd6d-440a-a527-2fe86e985a41 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:41.133930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592686b-cd6d-440a-a527-2fe86e985a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:41.134348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592686b-cd6d-440a-a527-2fe86e985a41 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:41.135156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592686b-cd6d-440a-a527-2fe86e985a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:41.135667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592686b-cd6d-440a-a527-2fe86e985a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:41.137255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592686b-cd6d-440a-a527-2fe86e985a41 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:41.150375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 237/470] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:41.153078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443054-bdc1-4109-8092-32f4374519a8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:41.156097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443054-bdc1-4109-8092-32f4374519a8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:41.156544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443054-bdc1-4109-8092-32f4374519a8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:41.158505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 238/471] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:41.159423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443054-bdc1-4109-8092-32f4374519a8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:41.198010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15c47e-426e-47ee-91bc-72792d4e7c27 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:41.244638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903c45-ea76-44df-b2fe-6891b5c59401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:41.245275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903c45-ea76-44df-b2fe-6891b5c59401 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:41.245558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903c45-ea76-44df-b2fe-6891b5c59401 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:41.245892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903c45-ea76-44df-b2fe-6891b5c59401 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:41.246542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903c45-ea76-44df-b2fe-6891b5c59401 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:41.248218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903c45-ea76-44df-b2fe-6891b5c59401 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:41.272770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 234/472] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:08:41 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:41.274552 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78544-3eee-42a1-b0bf-43bafcf286f8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:41.275786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78544-3eee-42a1-b0bf-43bafcf286f8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:41.276332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78544-3eee-42a1-b0bf-43bafcf286f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:41.284612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443054-bdc1-4109-8092-32f4374519a8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:41.303265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2bd78544-3eee-42a1-b0bf-43bafcf286f8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:41.304637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2bd78544-3eee-42a1-b0bf-43bafcf286f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:41.332104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b74951-2ab2-4bf5-b245-b1f5be64dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:41.333053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74951-2ab2-4bf5-b245-b1f5be64dfdc None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:41.333464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74951-2ab2-4bf5-b245-b1f5be64dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:41.333780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74951-2ab2-4bf5-b245-b1f5be64dfdc None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:41.334723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:41.335628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b74951-2ab2-4bf5-b245-b1f5be64dfdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:41.337382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b74951-2ab2-4bf5-b245-b1f5be64dfdc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:41.369781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 239/473] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:08:41 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:41.370795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b74951-2ab2-4bf5-b245-b1f5be64dfdc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:41.389692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:41.436056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 235/474] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:41.506818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b74951-2ab2-4bf5-b245-b1f5be64dfdc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:41.554952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:41.556001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:41.556493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:41.557005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:41.571163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:41.573064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:41.589864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:41.590840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:41.591700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:41.591700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:41.591700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:41.593882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 240/475] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:41.600071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd78544-3eee-42a1-b0bf-43bafcf286f8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:41.726165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd78544-3eee-42a1-b0bf-43bafcf286f8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:41.767042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:41.772030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:41.773974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:41.774451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:41.774897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:41.775764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:41.776505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:41.778154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:41.797066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 236/476] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:41.802838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:41.827443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:41.896648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:41.975013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbb76f-e837-47c5-8bf7-8be2d3ebb3a4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:42.008079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069abd-8433-4f83-a5eb-84adeaa353d1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:42.024653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11101d-a2ef-4b22-892b-13f7aa2e0622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:42.025719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11101d-a2ef-4b22-892b-13f7aa2e0622 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:42.026490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11101d-a2ef-4b22-892b-13f7aa2e0622 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:42.026961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11101d-a2ef-4b22-892b-13f7aa2e0622 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:42.027833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11101d-a2ef-4b22-892b-13f7aa2e0622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:42.029625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11101d-a2ef-4b22-892b-13f7aa2e0622 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:42.053310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:42.054250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:42.054683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:42.055173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:42.056073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:42.057945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:42.068048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 237/477] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:08:41 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:42.081530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 12:08:42.081530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 06 12:08:42.081530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [parameters: {'id': '4eaffa5f36174acf9a30d38748d912ed', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 06 12:08:42.081530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Oct 06 12:08:42.105123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return ref.to_dict() Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 12:08:42.106298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 12:08:42.107480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 12:08:42.108539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:08:42.114877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:08:42.115912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'id': '4eaffa5f36174acf9a30d38748d912ed', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:42.116865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 06 12:08:42.117856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:42.120261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 241/478] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Oct 6 12:08:41 2022] POST /identity/v3/roles => generated 144 bytes in 354 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:42.127659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11101d-a2ef-4b22-892b-13f7aa2e0622 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:42.267839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:42.308524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11101d-a2ef-4b22-892b-13f7aa2e0622 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:42.349803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b33d6-99e2-4bcc-9a2e-9abb70914797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:42.350535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b33d6-99e2-4bcc-9a2e-9abb70914797 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:42.350817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b33d6-99e2-4bcc-9a2e-9abb70914797 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:42.351089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b33d6-99e2-4bcc-9a2e-9abb70914797 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:42.362209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b33d6-99e2-4bcc-9a2e-9abb70914797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-858b33d6-99e2-4bcc-9a2e-9abb70914797 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:42.368328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:42.369221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 06 12:08:42.370064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:42.373656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 238/479] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:08:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:42.375689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:42.481368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc291c-e0cb-41d6-9846-72286e6a60b2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:42.510528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:42.525613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c234a-5505-421a-9abf-5186b113296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:42.526482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c234a-5505-421a-9abf-5186b113296b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:42.526766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c234a-5505-421a-9abf-5186b113296b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:42.527041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c234a-5505-421a-9abf-5186b113296b None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:42.527718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c234a-5505-421a-9abf-5186b113296b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:42.528095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c234a-5505-421a-9abf-5186b113296b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:42.529517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c234a-5505-421a-9abf-5186b113296b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:42.540314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 242/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:43.729083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587f7dc-7525-4e72-82a5-4efaece050ca None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:43.729625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587f7dc-7525-4e72-82a5-4efaece050ca None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:43.729906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587f7dc-7525-4e72-82a5-4efaece050ca None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:43.731455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 239/481] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:43.737627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df01c5-3ca4-457c-93bc-e479fcfc30ed None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:43.738975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df01c5-3ca4-457c-93bc-e479fcfc30ed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:43.738975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df01c5-3ca4-457c-93bc-e479fcfc30ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:43.766935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f8df01c5-3ca4-457c-93bc-e479fcfc30ed None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:43.768304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f8df01c5-3ca4-457c-93bc-e479fcfc30ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:43.864364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 243/482] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:44.080406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95986-2bbd-4373-81e4-c492be9c7b88 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:44.080744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95986-2bbd-4373-81e4-c492be9c7b88 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:44.080918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf95986-2bbd-4373-81e4-c492be9c7b88 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:44.082773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 240/483] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:44.088187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286be7e4-c118-4268-b0c5-f1a851942b47 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:44.088480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286be7e4-c118-4268-b0c5-f1a851942b47 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:44.088761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286be7e4-c118-4268-b0c5-f1a851942b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:44.113962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-286be7e4-c118-4268-b0c5-f1a851942b47 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:44.115225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-286be7e4-c118-4268-b0c5-f1a851942b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:44.195505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf95986-2bbd-4373-81e4-c492be9c7b88 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:44.217561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 244/484] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:44.346879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf95986-2bbd-4373-81e4-c492be9c7b88 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:44.402673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f53f2-d5c3-4edc-b867-9b0b215389ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:44.403514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f53f2-d5c3-4edc-b867-9b0b215389ec None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:44.403776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f53f2-d5c3-4edc-b867-9b0b215389ec None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:44.404051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f53f2-d5c3-4edc-b867-9b0b215389ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:44.407437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:44.418148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f53f2-d5c3-4edc-b867-9b0b215389ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-384f53f2-d5c3-4edc-b867-9b0b215389ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:44.423022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:44.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:44.424746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 241/485] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:44.434929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286be7e4-c118-4268-b0c5-f1a851942b47 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:44.501397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:44.528354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f53f2-d5c3-4edc-b867-9b0b215389ec None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:44.602950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286be7e4-c118-4268-b0c5-f1a851942b47 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:44.664926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333af946-ec53-4526-8d5b-d0e283bbcd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:44.665556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af946-ec53-4526-8d5b-d0e283bbcd45 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:44.665855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af946-ec53-4526-8d5b-d0e283bbcd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:44.666125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af946-ec53-4526-8d5b-d0e283bbcd45 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:44.666801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af946-ec53-4526-8d5b-d0e283bbcd45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:44.667101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af946-ec53-4526-8d5b-d0e283bbcd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:44.668467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af946-ec53-4526-8d5b-d0e283bbcd45 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:44.678886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 245/486] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:44.684531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad81dc-fd84-4720-a228-349401b0247e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:44.684531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad81dc-fd84-4720-a228-349401b0247e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:44.684531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad81dc-fd84-4720-a228-349401b0247e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:44.684531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 246/487] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:44.686624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad81dc-fd84-4720-a228-349401b0247e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:44.701917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f53f2-d5c3-4edc-b867-9b0b215389ec None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:44.752812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ac96f-2d7f-465f-b02e-afb749e765c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:44.753474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ac96f-2d7f-465f-b02e-afb749e765c4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:44.753976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ac96f-2d7f-465f-b02e-afb749e765c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:44.754250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ac96f-2d7f-465f-b02e-afb749e765c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:44.766725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ac96f-2d7f-465f-b02e-afb749e765c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-da6ac96f-2d7f-465f-b02e-afb749e765c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:44.773205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:44.774342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:44.775145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 242/488] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:44.776449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed27f0-17ac-40dd-8da0-8b1dc867d239 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:44.776449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed27f0-17ac-40dd-8da0-8b1dc867d239 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:44.776715 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed27f0-17ac-40dd-8da0-8b1dc867d239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:44.795988 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-99ed27f0-17ac-40dd-8da0-8b1dc867d239 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:44.797196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-99ed27f0-17ac-40dd-8da0-8b1dc867d239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:44.818973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad81dc-fd84-4720-a228-349401b0247e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:44.827808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:44.855424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:44.864791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:44.865907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:44.866388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:44.866855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:44.885606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 243/489] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:44.885606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed27f0-17ac-40dd-8da0-8b1dc867d239 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:44.888220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:44.889855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:44.921936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:44.923099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:44.924157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:44.924157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:44.924157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:44.931134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 247/490] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:44.934230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.116365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed27f0-17ac-40dd-8da0-8b1dc867d239 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.120582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac56035-bc5b-4de7-93c3-892b503810f8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.175799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c733f0-bcd9-4191-a565-4a66a0b1c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.176592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c733f0-bcd9-4191-a565-4a66a0b1c3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.176882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c733f0-bcd9-4191-a565-4a66a0b1c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.177229 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c733f0-bcd9-4191-a565-4a66a0b1c3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.178003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c733f0-bcd9-4191-a565-4a66a0b1c3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:45.178399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c733f0-bcd9-4191-a565-4a66a0b1c3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:45.180751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c733f0-bcd9-4191-a565-4a66a0b1c3a0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:45.193363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7efd1-8b3d-4114-a053-a96969340792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.194383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7efd1-8b3d-4114-a053-a96969340792 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.194882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7efd1-8b3d-4114-a053-a96969340792 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.195374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7efd1-8b3d-4114-a053-a96969340792 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.196252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7efd1-8b3d-4114-a053-a96969340792 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:45.196750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7efd1-8b3d-4114-a053-a96969340792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:45.197501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 248/491] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:45.198609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7efd1-8b3d-4114-a053-a96969340792 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:45.198833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f116-d4a9-40d7-9287-d1e79538db59 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.199121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f116-d4a9-40d7-9287-d1e79538db59 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.199395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f116-d4a9-40d7-9287-d1e79538db59 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.200845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 249/492] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:45.209693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3f116-d4a9-40d7-9287-d1e79538db59 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.217026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 244/493] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:45.223571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca9b67-48f5-4a81-9b37-d9bba17632d7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.223849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca9b67-48f5-4a81-9b37-d9bba17632d7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.224129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca9b67-48f5-4a81-9b37-d9bba17632d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.230804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:45.243640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b6ca9b67-48f5-4a81-9b37-d9bba17632d7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:45.244822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b6ca9b67-48f5-4a81-9b37-d9bba17632d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:45.290385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:45.317283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 245/494] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:45.318261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca9b67-48f5-4a81-9b37-d9bba17632d7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.320326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3f116-d4a9-40d7-9287-d1e79538db59 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.357049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.357717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.358002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.358274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.366443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:45.367872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:45.380907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:45.381849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:45.382750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 250/495] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:45.383357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.438427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca9b67-48f5-4a81-9b37-d9bba17632d7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.465808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:45.475910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a754eb-c2a0-4d86-93ea-09ada8149cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.476543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a754eb-c2a0-4d86-93ea-09ada8149cff None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.476819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a754eb-c2a0-4d86-93ea-09ada8149cff None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.477087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a754eb-c2a0-4d86-93ea-09ada8149cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.487346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a754eb-c2a0-4d86-93ea-09ada8149cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:45.489451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a754eb-c2a0-4d86-93ea-09ada8149cff None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:45.491238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff68372-b8fd-49f0-b1bb-6a2a144a0bdb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e2a754eb-c2a0-4d86-93ea-09ada8149cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:45.505383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:45.506543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:45.507390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:45.507390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:45.507390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:45.507390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 246/496] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:45.508166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf67ff-fc10-4458-bf8f-60492de4d8cb None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.508166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf67ff-fc10-4458-bf8f-60492de4d8cb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.508166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf67ff-fc10-4458-bf8f-60492de4d8cb None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.509625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 247/497] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:45.510111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf67ff-fc10-4458-bf8f-60492de4d8cb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.537661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11ba09-cf29-41dd-b616-13b4b0d5dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.538305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11ba09-cf29-41dd-b616-13b4b0d5dc78 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.538699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11ba09-cf29-41dd-b616-13b4b0d5dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.538979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11ba09-cf29-41dd-b616-13b4b0d5dc78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.542156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:45.552282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11ba09-cf29-41dd-b616-13b4b0d5dc78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ad11ba09-cf29-41dd-b616-13b4b0d5dc78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:45.557794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:45.558872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 251/498] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:45.562521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11ba09-cf29-41dd-b616-13b4b0d5dc78 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.625637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf67ff-fc10-4458-bf8f-60492de4d8cb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.659320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b21ddf-2ad7-45bc-b892-5a08581e6fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.660582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b21ddf-2ad7-45bc-b892-5a08581e6fef None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.660956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b21ddf-2ad7-45bc-b892-5a08581e6fef None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.661232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b21ddf-2ad7-45bc-b892-5a08581e6fef None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.662000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b21ddf-2ad7-45bc-b892-5a08581e6fef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:45.662304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b21ddf-2ad7-45bc-b892-5a08581e6fef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:45.663743 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b21ddf-2ad7-45bc-b892-5a08581e6fef None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:45.667155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11ba09-cf29-41dd-b616-13b4b0d5dc78 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.700423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 248/499] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:45.700900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.701510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.701821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.702097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.702185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd01d-b783-4c71-bc89-57cdbb43192f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.702572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd01d-b783-4c71-bc89-57cdbb43192f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.702752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:45.703024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd01d-b783-4c71-bc89-57cdbb43192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.703109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:45.704421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:45.713180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:45.719181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 252/500] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:45.719982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.721786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2d1cd01d-b783-4c71-bc89-57cdbb43192f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:45.723644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d1cd01d-b783-4c71-bc89-57cdbb43192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:45.789513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 249/501] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:45.790385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cd01d-b783-4c71-bc89-57cdbb43192f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.814622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:45.832854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96784a1-3101-4b46-9c29-4ed75b77bc8c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.868225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.869099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.869514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.869956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.870770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:45.871233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:45.872809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:45.881861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 253/502] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:45.882839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.914072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cd01d-b783-4c71-bc89-57cdbb43192f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:45.948640 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:45.951055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:45.951752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:45.952036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:45.952300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:45.963302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:45.964771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:45.980494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:45.981461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:45.982379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:45.982379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:45.982379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:45.982379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 250/503] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:45.982379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:45.999618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e401efa-96c0-4030-b6b6-dc66323bfbe7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.042816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bda4e-e3ab-4ac2-8b1c-6b6255c12685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.043705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bda4e-e3ab-4ac2-8b1c-6b6255c12685 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.044166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bda4e-e3ab-4ac2-8b1c-6b6255c12685 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.044601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bda4e-e3ab-4ac2-8b1c-6b6255c12685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.056176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:46.091666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7ac2c-fc85-4127-9e55-863e9456db11 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.120198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bda4e-e3ab-4ac2-8b1c-6b6255c12685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.121692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bda4e-e3ab-4ac2-8b1c-6b6255c12685 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.127662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.127662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.127662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.127662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.135738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.137142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:46.151202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:46.152271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:46.153279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 251/504] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:46.157639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.181269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:46.225180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 254/505] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:46.226168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bda4e-e3ab-4ac2-8b1c-6b6255c12685 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.258215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b378cc-5ca6-41f2-8256-d395b80ac463 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.284619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:46.294129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.294763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.295047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.295326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.306038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.307508 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:46.322408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:46.323523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:46.324551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:46.324551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:46.324551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:46.324551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 252/506] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:46.324823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.328489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bda4e-e3ab-4ac2-8b1c-6b6255c12685 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.363836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.364440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.364720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.364994 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.365668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:46.365971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.367335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.378371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 255/507] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:46.379861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.402714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:46.428908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988ad8-8f17-4dbf-adc0-15b0b6e58adb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.462411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1761-fd4f-461e-92d2-3b018128561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.463045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1761-fd4f-461e-92d2-3b018128561a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.463323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1761-fd4f-461e-92d2-3b018128561a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.463596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1761-fd4f-461e-92d2-3b018128561a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.474660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c1761-fd4f-461e-92d2-3b018128561a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-659c1761-fd4f-461e-92d2-3b018128561a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:46.484155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:46.485050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:46.485943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:46.486551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3167f23-b1ae-4ae0-abaf-43a72a3079e3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.486623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 253/508] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:46.487389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1761-fd4f-461e-92d2-3b018128561a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.526370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.526976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.527258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.527531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.528256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:46.528560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.530018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.537061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:46.567976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 256/509] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:46.568816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.597507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1761-fd4f-461e-92d2-3b018128561a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.632257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.632887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.633415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.633726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.644839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.646349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.647807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:46.661383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:46.662491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:46.663649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:46.663649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:46.663649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:46.665798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 254/510] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:46.666568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.672489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabff94b-895c-4d90-b5b3-c2effc750ebb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.708649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.709277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.709854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.709990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.710571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:46.710873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.712236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.723415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 257/511] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:46.724259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.764428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:46.773524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eeb7a0-de20-4b7b-8dec-09d0994ab6f4 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.807933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673d877-0143-4eb2-a192-1420808acace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.808572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673d877-0143-4eb2-a192-1420808acace None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.808805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673d877-0143-4eb2-a192-1420808acace None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.809081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673d877-0143-4eb2-a192-1420808acace None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.809767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673d877-0143-4eb2-a192-1420808acace None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.811205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673d877-0143-4eb2-a192-1420808acace None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.825706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bb9de-bbbf-4429-b133-422cebd61be2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.833024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 255/512] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:08:46 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:08:46.833979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673d877-0143-4eb2-a192-1420808acace None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.867631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.868369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.868555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.868815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:46.869512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:46.869852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:46.871287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:46.879224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:46.883831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 258/513] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:46.885039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:46.957435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673d877-0143-4eb2-a192-1420808acace None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:46.998167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a5ae5-bce5-4b9f-98b6-71147c1230e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:46.998787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a5ae5-bce5-4b9f-98b6-71147c1230e6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:46.999066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a5ae5-bce5-4b9f-98b6-71147c1230e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:46.999340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a5ae5-bce5-4b9f-98b6-71147c1230e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.000074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73142b-ac46-4791-b12b-feb9c31da890 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.020583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:47.045526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.046163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.047543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.047543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.047543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:47.047758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.049187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.063785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 259/514] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:47.064898 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.087475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a5ae5-bce5-4b9f-98b6-71147c1230e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.088988 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a5ae5-bce5-4b9f-98b6-71147c1230e6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.132971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:47.176895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b21e42-e85a-405d-a184-749c532c5559 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.213159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 256/515] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:47.214003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a5ae5-bce5-4b9f-98b6-71147c1230e6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.216317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.216967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.217254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.217557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.225695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.227156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:47.240349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:47.241555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 12:08:47.242495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:47.243017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 260/516] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:47.243507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.276701 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:47.333089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a5ae5-bce5-4b9f-98b6-71147c1230e6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.352514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e9a9-510e-4042-aaaf-b61e9f7712de None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.371923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.372562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.372847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.373120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.374579 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:47.385008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.386624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.391057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.391686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.392043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.392320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.399869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.401562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:47.402336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:47.403205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:47.404201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:47.404201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:47.404201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:47.404201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 257/517] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:47.404799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:47.420012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:47.420956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:47.421873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 261/518] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:47.422365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.515450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:47.518335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce965af-c1ee-4ad5-8118-ce83856ca23a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.538256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36250477-50cd-4f06-b724-3b344ac85c60 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.557638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.558274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.558553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.558825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.572186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.573709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.574554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.575169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.575460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.575740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.576487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:47.576798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.578258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:47.589290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:47.590445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:47.591291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:47.591291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:47.591291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:47.593861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 258/519] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:47.594987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.597968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 262/520] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:47.599018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.648053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:47.700111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cf9fe-fe8c-427d-9760-1c02f8f0cb71 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.714037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf8ebf-3b1b-49e3-8581-b3d6a32ed2e8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.741485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.742107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.742388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.742658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.743297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:47.743596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.744966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.754845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.755941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.756398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.756778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.757750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:47.758124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.759711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.764816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 259/521] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:47.764816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.780675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 263/522] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:47.782610 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:47.786606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.874810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03677-aab4-44f7-bd39-508186ccdd87 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.895137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:47.899251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79794-cc27-4a35-bb21-51f1e236a8d0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:47.912711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.913594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.914021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.914441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:47.915229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:47.915679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:47.917216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:47.935145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 260/523] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:47.936252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:47.937028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff60d7c-36e1-463c-99fe-c0f6a2296bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:47.937698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60d7c-36e1-463c-99fe-c0f6a2296bbc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:47.937982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60d7c-36e1-463c-99fe-c0f6a2296bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:47.938255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60d7c-36e1-463c-99fe-c0f6a2296bbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.010819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff60d7c-36e1-463c-99fe-c0f6a2296bbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.012285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff60d7c-36e1-463c-99fe-c0f6a2296bbc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.014144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:48.046994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3842a09-e98d-48d9-a566-6de38a0adce1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:48.084092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:48.084731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:48.085013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:48.085294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.093039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.096809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:48.107620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:48.108538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 261/524] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:48.109478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.135092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:48.135399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 264/525] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:48.137283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff60d7c-36e1-463c-99fe-c0f6a2296bbc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.218789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0abd2f-486b-4123-a15d-92428ec74cbc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:48.250781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:48.252877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff60d7c-36e1-463c-99fe-c0f6a2296bbc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:48.257365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:48.258457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:48.258797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:48.259078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.259816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=1bd257708357455d99990b01af81e5b0) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:48.260130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.261679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.277571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 262/526] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/role_assignments?user.id=1bd257708357455d99990b01af81e5b0&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:48.277571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.304106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:48.304876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:48.305160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:48.305432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.313316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.314813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:48.328345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:48.329356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:48.330224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 265/527] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:48.330689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.411551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:48.426152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe932fbf-2cfd-462e-ba2f-a10f0d4393ca None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:48.479285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4781a-cfd6-4953-9afc-8006121e411a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:48.484832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:48.486020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:48.486526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:48.486991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.489225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:48.490484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.493116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.520162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 263/528] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:48.521392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.527163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:48.527163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:48.527503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:48.527892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.539077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.540617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:48.557631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:48.558591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:48.559428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:48.559428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:48.559428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:48.559428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 266/529] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:48.560257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.605906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:48.665949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57852c67-519a-408c-8799-4ec19c80a8d7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:48.675946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0241e4-8901-47f6-a95a-ed0449087f58 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:48.714139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:48.715951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:48.716729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:48.717171 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:48.717584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378737cb-d6d8-46a3-96b5-be1394d08a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:48.717797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.718477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378737cb-d6d8-46a3-96b5-be1394d08a69 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:48.718778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:48.718933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378737cb-d6d8-46a3-96b5-be1394d08a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:48.719305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378737cb-d6d8-46a3-96b5-be1394d08a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.719502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.721187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.745382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 264/530] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:48.746777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.813285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378737cb-d6d8-46a3-96b5-be1394d08a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.815118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378737cb-d6d8-46a3-96b5-be1394d08a69 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.870691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bec5-2636-4c53-8577-d8deabb3f899 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:48.887514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:48.911243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:48.912020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:48.912505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:48.912979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:48.913953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:48.914324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:48.915817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:48.929136 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 265/531] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:48.930160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.954172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 267/532] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:48.955055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378737cb-d6d8-46a3-96b5-be1394d08a69 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:48.971204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:49.068850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5583800-1d2c-4c5b-bb42-d001ee08743d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:49.087990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378737cb-d6d8-46a3-96b5-be1394d08a69 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:49.107732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:49.108346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.108625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.108913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.109871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=f401923fe84446b9962e854f1fc2bed3) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:49.109995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:49.111379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:49.118037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 266/533] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/role_assignments?user.id=f401923fe84446b9962e854f1fc2bed3&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:49.118832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:49.145595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7f31f-f4f2-4ad2-83eb-3f2a0858c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:49.146266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7f31f-f4f2-4ad2-83eb-3f2a0858c203 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.146550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7f31f-f4f2-4ad2-83eb-3f2a0858c203 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.146825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7f31f-f4f2-4ad2-83eb-3f2a0858c203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.155754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7f31f-f4f2-4ad2-83eb-3f2a0858c203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:49.157238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7f31f-f4f2-4ad2-83eb-3f2a0858c203 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3ca7f31f-f4f2-4ad2-83eb-3f2a0858c203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:49.170619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:49.171596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:49.172520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 268/534] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:49.173821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67321996-d338-4389-ac8b-e2f155aa1962 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.173821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67321996-d338-4389-ac8b-e2f155aa1962 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.173996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67321996-d338-4389-ac8b-e2f155aa1962 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.175926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 269/535] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:49.177977 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:49.179957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67321996-d338-4389-ac8b-e2f155aa1962 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:49.268375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:49.276704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c18365-e0e4-4c7c-9619-42985a6ef9fe None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:49.312210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67321996-d338-4389-ac8b-e2f155aa1962 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:49.335470 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:49.336749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.337192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.337643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.352833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:49.354752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:49.355184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10ee61-1de6-49d1-ad81-064d7cd03dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:49.356123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10ee61-1de6-49d1-ad81-064d7cd03dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.356542 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10ee61-1de6-49d1-ad81-064d7cd03dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.356913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10ee61-1de6-49d1-ad81-064d7cd03dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.357733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10ee61-1de6-49d1-ad81-064d7cd03dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:49.358180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10ee61-1de6-49d1-ad81-064d7cd03dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:49.359729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10ee61-1de6-49d1-ad81-064d7cd03dc7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:49.373326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 270/536] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:49.374484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:49.375563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:49.376589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:49.376589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:49.376589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:49.376763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a4ec-2eef-45f1-95dd-568fb528664c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.376763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a4ec-2eef-45f1-95dd-568fb528664c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.376894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a4ec-2eef-45f1-95dd-568fb528664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.378783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 267/537] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:49.379779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:49.401262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2895a4ec-2eef-45f1-95dd-568fb528664c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:49.402603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2895a4ec-2eef-45f1-95dd-568fb528664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:49.478584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 271/538] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:49.479615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a4ec-2eef-45f1-95dd-568fb528664c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:49.502525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:49.516725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a537b-a59d-49b5-8bb7-8c20edb5945d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:49.545374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:49.569231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:49.570448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.570886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.571306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.572441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=945f11bdc38e4728a78449d99a0fcbdc) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:49.573365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:49.575512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:49.583879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 268/539] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:49 2022] GET /identity/v3/role_assignments?user.id=945f11bdc38e4728a78449d99a0fcbdc&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:49.598679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a4ec-2eef-45f1-95dd-568fb528664c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:49.642749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:49.643394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.643676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.643976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.644922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:49.645228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:49.646690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:49.667223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 272/540] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:49.673102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:49.811101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e4f3d-a746-4b91-bd34-c4dd4ca08d80 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:49.842814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:49.857383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:49.858023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:49.858305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:49.858632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:49.868270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:49.868937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:49.883245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:49.884130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:49.884946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 269/541] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:49.890756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:49.909644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:50.025555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3f9d-a8df-4f16-bf60-734c5b34c884 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:50.079261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9404-bbe2-401f-98c7-dce97136393a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:50.104884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:50.110344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:50.110923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:50.111216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:50.111498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:50.112213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:50.112530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:50.114502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:50.126890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d2f8c-0ee4-4353-bad4-6e66ed96c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:50.127494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d2f8c-0ee4-4353-bad4-6e66ed96c54c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:50.127860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d2f8c-0ee4-4353-bad4-6e66ed96c54c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:50.127963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d2f8c-0ee4-4353-bad4-6e66ed96c54c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:50.143916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 270/542] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:50.146034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d2f8c-0ee4-4353-bad4-6e66ed96c54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:50.150466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-970d2f8c-0ee4-4353-bad4-6e66ed96c54c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:50.161158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:50.162130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:50.162947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:50.165827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 273/543] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:50.170542 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d2f8c-0ee4-4353-bad4-6e66ed96c54c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:50.296459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:50.318435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d2f8c-0ee4-4353-bad4-6e66ed96c54c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:50.342093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883636f-cd39-46a1-a317-2c4c7b9b89e0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:50.357106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741b994-6a47-4854-bc67-01467238528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:50.357783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741b994-6a47-4854-bc67-01467238528f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:50.358074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741b994-6a47-4854-bc67-01467238528f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:50.358366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741b994-6a47-4854-bc67-01467238528f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:50.359055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741b994-6a47-4854-bc67-01467238528f None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:50.359363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741b994-6a47-4854-bc67-01467238528f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:50.360811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741b994-6a47-4854-bc67-01467238528f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:50.372340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 274/544] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:50.382631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741b994-6a47-4854-bc67-01467238528f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:50.407271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:50.408268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:50.408756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:50.409225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:50.410859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=c8bc6ac1df7f4bd383fded2b9a22ecf3) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:50.411407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:50.413080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:50.429498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 271/545] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:50 2022] GET /identity/v3/role_assignments?user.id=c8bc6ac1df7f4bd383fded2b9a22ecf3&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:50.442335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:50.527128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741b994-6a47-4854-bc67-01467238528f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:50.574732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:50.575409 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:50.575788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:50.575975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:50.592449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:50.594989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:50.615441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:50.616374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:50.617216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:50.617216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:50.617216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:50.617216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 275/546] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:50.624107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:50.806586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909983b-f910-45f4-a775-d47d73c410bc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:50.866679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2a2d8-dd88-48bc-923d-ab9b06bdf77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:50.867686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2a2d8-dd88-48bc-923d-ab9b06bdf77e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:50.868185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2a2d8-dd88-48bc-923d-ab9b06bdf77e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:50.868647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2a2d8-dd88-48bc-923d-ab9b06bdf77e None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:50.869507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2a2d8-dd88-48bc-923d-ab9b06bdf77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:50.870122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2a2d8-dd88-48bc-923d-ab9b06bdf77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:50.871829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2a2d8-dd88-48bc-923d-ab9b06bdf77e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:50.886420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 272/547] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:50.889600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:50.892839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:50.934795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb756-883c-476d-bf37-5fb094e71475 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:50.935467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb756-883c-476d-bf37-5fb094e71475 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:50.935658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb756-883c-476d-bf37-5fb094e71475 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:50.937567 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 273/548] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:50.948970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408b45b-1e36-4e75-b2d2-ee5a23f4f211 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:50.949452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408b45b-1e36-4e75-b2d2-ee5a23f4f211 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:50.949828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408b45b-1e36-4e75-b2d2-ee5a23f4f211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:50.996961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5408b45b-1e36-4e75-b2d2-ee5a23f4f211 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:50.999126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5408b45b-1e36-4e75-b2d2-ee5a23f4f211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:51.111453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 274/549] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:08:51.134410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:51.145338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ee70e-4b2a-48d3-b645-64e5f67d37ab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:51.192507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:51.193235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:51.193528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:51.193756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:51.202977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:51.204475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:51.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:51.221046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:51.222616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 276/550] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:08:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:51.231002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408b45b-1e36-4e75-b2d2-ee5a23f4f211 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:51.396526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408b45b-1e36-4e75-b2d2-ee5a23f4f211 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:51.451959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:51.469035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:51.469739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:51.470027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:51.470308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:51.471121 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:51.471480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:51.473938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:51.514782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 275/551] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Oct 6 12:08:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:51.521913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:51.559159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:51.707005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349cfa8-7589-4b07-998c-3a3ac3847fc5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:51.783860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db15c7-7751-4ddb-870f-8d56bfce0451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:51.788908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db15c7-7751-4ddb-870f-8d56bfce0451 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:51.789254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db15c7-7751-4ddb-870f-8d56bfce0451 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:51.789549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db15c7-7751-4ddb-870f-8d56bfce0451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:51.820788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b38b-bad7-4400-aa4a-d1246daf4e26 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:51.859926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:51.899697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a5879-ac6b-41ec-97e0-d48850cd49a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:51.900363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a5879-ac6b-41ec-97e0-d48850cd49a6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:51.900895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a5879-ac6b-41ec-97e0-d48850cd49a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:51.901183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a5879-ac6b-41ec-97e0-d48850cd49a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:51.934881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a5879-ac6b-41ec-97e0-d48850cd49a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4d3a5879-ac6b-41ec-97e0-d48850cd49a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:51.941693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:51.942795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:51.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:51.944247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db15c7-7751-4ddb-870f-8d56bfce0451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:51.944247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db15c7-7751-4ddb-870f-8d56bfce0451 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:51.951513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 276/552] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:51.959006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a5879-ac6b-41ec-97e0-d48850cd49a6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.047884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:52.114148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 277/553] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:08:52.115303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a5879-ac6b-41ec-97e0-d48850cd49a6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:52.120213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb5d07-bf2b-45ae-a154-22222f15c001 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.120765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb5d07-bf2b-45ae-a154-22222f15c001 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.121255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb5d07-bf2b-45ae-a154-22222f15c001 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.122860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 278/554] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:52.123790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb5d07-bf2b-45ae-a154-22222f15c001 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.159357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ab8c5-fe55-4fa5-b766-155173186a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:52.160388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ab8c5-fe55-4fa5-b766-155173186a4b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.160834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ab8c5-fe55-4fa5-b766-155173186a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.161251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ab8c5-fe55-4fa5-b766-155173186a4b None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.162293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ab8c5-fe55-4fa5-b766-155173186a4b None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:52.162819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ab8c5-fe55-4fa5-b766-155173186a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:52.164323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ab8c5-fe55-4fa5-b766-155173186a4b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:52.173848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 277/555] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:52.176144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b0ad-c400-409b-9fd4-7878d90b47c0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.176747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b0ad-c400-409b-9fd4-7878d90b47c0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.177177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b0ad-c400-409b-9fd4-7878d90b47c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.191061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:52.200110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0544b0ad-c400-409b-9fd4-7878d90b47c0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:52.201565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0544b0ad-c400-409b-9fd4-7878d90b47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:52.239734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb5d07-bf2b-45ae-a154-22222f15c001 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:52.277011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:52.277820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.278197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.278566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.293661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 278/556] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:52.295095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544b0ad-c400-409b-9fd4-7878d90b47c0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.314526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:52.316399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:52.345656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:52.351807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:52.352948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:52.353858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:52.353858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:52.353858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:52.363917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 279/557] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:52.369369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.423058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544b0ad-c400-409b-9fd4-7878d90b47c0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:52.470257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53d664-2adb-4e57-9aae-ffdee85d9b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:52.471525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d664-2adb-4e57-9aae-ffdee85d9b99 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.472720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d664-2adb-4e57-9aae-ffdee85d9b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.473281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d664-2adb-4e57-9aae-ffdee85d9b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.487324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53d664-2adb-4e57-9aae-ffdee85d9b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:52.489500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53d664-2adb-4e57-9aae-ffdee85d9b99 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-9b53d664-2adb-4e57-9aae-ffdee85d9b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:52.510739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:52.512381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:52.513456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:52.513456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:52.513456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:52.515903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 279/558] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:52.517295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273538-489a-4e0e-9664-3d2677a92068 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.517756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273538-489a-4e0e-9664-3d2677a92068 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.518181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273538-489a-4e0e-9664-3d2677a92068 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.519980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 280/559] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:52.524217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6273538-489a-4e0e-9664-3d2677a92068 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.531780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889a26d-3fca-4e05-aab6-c1cc46f2f61b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:52.541468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:52.584392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ec6ce-80ef-4dbc-b74d-7d66d2032e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:52.585264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec6ce-80ef-4dbc-b74d-7d66d2032e05 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.585752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec6ce-80ef-4dbc-b74d-7d66d2032e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.586194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec6ce-80ef-4dbc-b74d-7d66d2032e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.587003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ec6ce-80ef-4dbc-b74d-7d66d2032e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:52.587452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ec6ce-80ef-4dbc-b74d-7d66d2032e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:52.588968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ec6ce-80ef-4dbc-b74d-7d66d2032e05 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:52.607089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 280/560] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:52.609237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c117f7-7701-41a6-ab18-d23ba53b1c8a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.609772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c117f7-7701-41a6-ab18-d23ba53b1c8a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.610702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c117f7-7701-41a6-ab18-d23ba53b1c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.633388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-06c117f7-7701-41a6-ab18-d23ba53b1c8a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:52.634626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-06c117f7-7701-41a6-ab18-d23ba53b1c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:52.654323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:52.667011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6273538-489a-4e0e-9664-3d2677a92068 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:52.707146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:52.707810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.708198 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.708467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.709235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:52.709565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:52.711041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:52.714204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 281/561] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:52.715421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c117f7-7701-41a6-ab18-d23ba53b1c8a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.730947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 281/562] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:52.730947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.850066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:52.858873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c117f7-7701-41a6-ab18-d23ba53b1c8a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:52.864025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc820e3-01fa-41ad-9f35-284925cbc0ac None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:52.905016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:52.905975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.906414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.906841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.908002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740ca9-ab84-4ce5-8333-d70da24559f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:52.908771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740ca9-ab84-4ce5-8333-d70da24559f0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:52.909155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740ca9-ab84-4ce5-8333-d70da24559f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:52.910446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58740ca9-ab84-4ce5-8333-d70da24559f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:52.916742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:52.918462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:52.923000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58740ca9-ab84-4ce5-8333-d70da24559f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-58740ca9-ab84-4ce5-8333-d70da24559f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:52.929490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:52.930673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:52.931627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 282/563] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:52.932754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740ca9-ab84-4ce5-8333-d70da24559f0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:52.935979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:52.936919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:52.937963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:52.937963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:52.937963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:52.937963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:52.937963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:52.937963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:52.937963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:52.937963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:52.940211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 282/564] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:52.941497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:52.955761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:53.070138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938b0c-17d1-474e-aa8e-a4dac5ea50b6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.076128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58740ca9-ab84-4ce5-8333-d70da24559f0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.113870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.114424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.114702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.114972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.116050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.116667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.116952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.117229 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.117942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:53.118251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:53.119647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:53.122530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:53.123970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:53.130857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 283/565] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:53.131729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:53.137744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:53.138724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 283/566] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:08:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:53.139648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.153745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:53.222590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:53.245763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ad0a-9f04-460d-8291-0ddf09220a5e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.255141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb36ff6-2d34-4228-8368-a0110569252c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.281660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247ac8c-cb4b-4591-a36d-e748461ebd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.282298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247ac8c-cb4b-4591-a36d-e748461ebd61 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.282584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247ac8c-cb4b-4591-a36d-e748461ebd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.282865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247ac8c-cb4b-4591-a36d-e748461ebd61 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.283609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247ac8c-cb4b-4591-a36d-e748461ebd61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:53.283920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247ac8c-cb4b-4591-a36d-e748461ebd61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:53.286667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247ac8c-cb4b-4591-a36d-e748461ebd61 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:53.292901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345521f9-21b8-4551-8bb0-bbb688dc815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.293561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345521f9-21b8-4551-8bb0-bbb688dc815c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.293857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345521f9-21b8-4551-8bb0-bbb688dc815c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.294143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345521f9-21b8-4551-8bb0-bbb688dc815c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.299139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 284/567] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:53.301990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4930f-f51f-4c24-af2f-52a1ddcfe234 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.302277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4930f-f51f-4c24-af2f-52a1ddcfe234 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.302697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4930f-f51f-4c24-af2f-52a1ddcfe234 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.305227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 285/568] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:53.306693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4930f-f51f-4c24-af2f-52a1ddcfe234 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.308635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345521f9-21b8-4551-8bb0-bbb688dc815c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-345521f9-21b8-4551-8bb0-bbb688dc815c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:53.316234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:53.317343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:53.318218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 284/569] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:53.318995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345521f9-21b8-4551-8bb0-bbb688dc815c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.387642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:53.412478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4930f-f51f-4c24-af2f-52a1ddcfe234 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.426705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345521f9-21b8-4551-8bb0-bbb688dc815c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.447726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.448361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.448641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.448921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.455157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:53.460889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:53.462282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983e114-18a7-4921-8784-de249f03ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.462434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:53.462895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983e114-18a7-4921-8784-de249f03ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.463174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983e114-18a7-4921-8784-de249f03ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.463441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983e114-18a7-4921-8784-de249f03ecb5 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.464172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983e114-18a7-4921-8784-de249f03ecb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:53.464470 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983e114-18a7-4921-8784-de249f03ecb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:53.465921 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983e114-18a7-4921-8784-de249f03ecb5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:53.477623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:53.478620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:53.479507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:53.479507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:53.479507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:53.479507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 286/570] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:53.479507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.487484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 285/571] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:53.489098 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7fed8-ea94-413c-aff0-d20164a18301 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.489380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7fed8-ea94-413c-aff0-d20164a18301 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.489686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7fed8-ea94-413c-aff0-d20164a18301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.508191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cbd7fed8-ea94-413c-aff0-d20164a18301 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:53.509407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cbd7fed8-ea94-413c-aff0-d20164a18301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:53.583634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 286/572] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:53.584738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7fed8-ea94-413c-aff0-d20164a18301 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.591278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae413d4-c20e-46b0-b4ec-83a0615c982a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.623203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:53.631059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.631681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.631964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.632237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.632973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=158a2959940b40378234c1ae5e566c97) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:53.633284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:53.634754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:53.649655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 287/573] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/role_assignments?user.id=158a2959940b40378234c1ae5e566c97&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:53.649655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.756548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7fed8-ea94-413c-aff0-d20164a18301 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.783408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e72eb-9d45-457d-924a-66f61450851c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.785607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:53.814875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.816850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.817409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.817880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.819720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:53.820242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:53.822509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:53.828398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:53.829119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:53.829416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:53.829760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:53.830526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:53.830846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:53.833065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:53.835500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 287/574] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:53.837254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.858417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 288/575] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:53.859411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:53.932991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:53.989988 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e12e-b806-447c-8897-b5604c50f821 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:53.996964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb047-0e52-4337-acff-192b2be40166 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.026354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.027005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.027269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.027538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.037289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.037975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.038260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.038536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.039898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.041373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.049816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.051903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:54.057594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:54.058562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:54.059446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:54.059446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:54.059446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:54.063342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 288/576] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:54.064059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:54.069573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:54.070536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:54.071463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:54.071463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:54.071463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:54.071463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 289/577] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:54.071687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.099478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:54.184723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0285-92d7-44a0-bca9-b110c3bbc1f9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.189869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc3837-b20e-4e58-adec-8e104ba9f070 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.197743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:54.221906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac833a-f83a-45aa-8fc0-4cafbe99eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.222667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac833a-f83a-45aa-8fc0-4cafbe99eeb0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.223145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac833a-f83a-45aa-8fc0-4cafbe99eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.223426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac833a-f83a-45aa-8fc0-4cafbe99eeb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.231959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.232602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.232885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.233159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.234627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac833a-f83a-45aa-8fc0-4cafbe99eeb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7aac833a-f83a-45aa-8fc0-4cafbe99eeb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:54.240725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:54.246983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:54.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:54.248533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.248937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 289/578] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:54.248937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac833a-f83a-45aa-8fc0-4cafbe99eeb0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.249063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:54.256498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:54.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 290/579] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:54.260133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.359207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:54.368463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5cf8e-cd30-4edd-82be-01eea6ec752f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.370154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac833a-f83a-45aa-8fc0-4cafbe99eeb0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.404937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.405521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.405831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.406104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.406749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:54.407050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.407983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.408413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.408589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.408877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.409154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.410442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:54.410834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.412330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.425759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 291/580] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:54.425759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.433995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 290/581] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:54.433995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.453913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:54.536112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65193f72-a3c5-427a-8b4d-32ef86a67f34 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.538087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99903-ea09-4067-84f0-6c4c488d6be3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.576992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.577656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.577949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.578230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.578919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:54.579230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.580688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.586100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.586721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.587002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.587331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.588063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:54.588369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.590231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.594992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 292/582] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:54.594992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.615357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 291/583] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:54.616037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.628875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:54.696062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:54.710320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c39cfa-b638-485a-bdb6-7a6995e0699c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.724167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e8bbd-89df-4979-b693-197fe23df23b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.746893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.747532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.747818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.748085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.757745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.759198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.760039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.760655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.760929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.761199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.768036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.770123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:54.771452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:54.772357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 293/584] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:54.773332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:54.787550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:54.788486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:54.789364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 292/585] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:54.790546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.862793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:54.889004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6c4fd-b30e-4315-9093-e95bb788044d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.899037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da290993-bd8c-4f88-8ba1-b55acf91661c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:54.928221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.928866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.929154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.929438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.943415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:54.944058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:54.944676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:54.944676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:54.948290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.949821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.956587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:54.958414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:54.959374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:54.966357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:54.967275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:54.968200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:54.968200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:54.968200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:54.972138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 294/586] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:54.972754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:54.973714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:54.974598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:54.975491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:54.975491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:54.975491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:54.979333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 293/587] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:54.980089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.078861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4bb9-6096-4934-a495-823ba15606d6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.087641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e7175-8316-468a-b2cd-e5f496de62e8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.114937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:55.119982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.120622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.120878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.121159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.122195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:55.122722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.124004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.127894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.128671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.128952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.129224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.130017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:55.130318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.132080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.145202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 294/588] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:55.149956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 295/589] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Oct 6 12:08:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:55.149956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.150952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.211821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:55.255893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523a5f8-171b-4e98-a98c-b12f6617771e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.260815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149e9c0-068a-41ba-88f8-4a5c06319c05 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.292501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.293202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.293573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.293923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.294660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:55.295024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.296461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.298958 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.299570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.299902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.300222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.301058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:55.301361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.302749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.312970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 295/590] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:55.312970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.324110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 296/591] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:55.324110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.360602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:55.420454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48768-64ab-4176-b38a-ca1ca3779bb7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.438527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fc9cc-15a6-4f2d-9454-bbf2646d3a83 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.455859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e1cc1-8b3c-4bd1-89f0-871c988d1f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.457122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e1cc1-8b3c-4bd1-89f0-871c988d1f3e None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.457398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e1cc1-8b3c-4bd1-89f0-871c988d1f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.457696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e1cc1-8b3c-4bd1-89f0-871c988d1f3e None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/1bd257708357455d99990b01af81e5b0/roles/473c27c2658941c492c7a8b45c37dddc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.460806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:55.472572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e1cc1-8b3c-4bd1-89f0-871c988d1f3e None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=1bd257708357455d99990b01af81e5b0, role_id=473c27c2658941c492c7a8b45c37dddc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.474062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e1cc1-8b3c-4bd1-89f0-871c988d1f3e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.482210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.482768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.483052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.483327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.488711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 296/592] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:55 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/1bd257708357455d99990b01af81e5b0/roles/473c27c2658941c492c7a8b45c37dddc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:55.489772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e1cc1-8b3c-4bd1-89f0-871c988d1f3e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.494893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.496497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:55.519551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:55.521136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:55.522085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:55.522085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:55.522085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:55.522085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 297/593] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:55.522085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.630271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:55.643668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e1cc1-8b3c-4bd1-89f0-871c988d1f3e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.673913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34045e-0175-42cd-9e12-53c055ae922b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.688178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.689209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.689712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.690184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.699886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.701686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:55.714820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:55.715814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 12:08:55.716763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:55.719297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 297/594] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:55.719825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.720569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.720737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.720837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.721113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.729142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.730627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:55.743792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:55.744739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:55.745707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 298/595] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:55.746203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.794978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:55.852122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b139146-0117-4fbd-9d3a-7aa38137b0cf None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.891498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef88d-b7eb-4c12-85e5-36ea89c59085 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:55.892066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.892805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.893186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.894308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.895825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:55.896239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.897802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.911438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 298/596] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:55.912494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:55.930436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:55.939150 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98919f6f-e9d5-46aa-83cf-9d9e66988d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:55.939772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98919f6f-e9d5-46aa-83cf-9d9e66988d4a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.940051 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98919f6f-e9d5-46aa-83cf-9d9e66988d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.940332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98919f6f-e9d5-46aa-83cf-9d9e66988d4a None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.941139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98919f6f-e9d5-46aa-83cf-9d9e66988d4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:55.941442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98919f6f-e9d5-46aa-83cf-9d9e66988d4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:55.942914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98919f6f-e9d5-46aa-83cf-9d9e66988d4a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:55.962881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 299/597] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:55.965001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14de5-a40d-4daa-b19b-212df058ea3f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:55.965715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14de5-a40d-4daa-b19b-212df058ea3f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:55.966164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14de5-a40d-4daa-b19b-212df058ea3f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:55.968347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 300/598] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:55.969491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14de5-a40d-4daa-b19b-212df058ea3f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.035006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a03fe-83ad-49b6-bf70-98687a94055d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:56.069610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:56.071011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:56.071922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.072237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.072505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.073195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:56.073499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:56.074955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:56.086710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 299/599] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:56.087363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.093718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14de5-a40d-4daa-b19b-212df058ea3f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:56.132866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6a2ee-e99a-4833-b8b7-e844a44b29b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:56.133508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6a2ee-e99a-4833-b8b7-e844a44b29b6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.133818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6a2ee-e99a-4833-b8b7-e844a44b29b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.134092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6a2ee-e99a-4833-b8b7-e844a44b29b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.140851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6a2ee-e99a-4833-b8b7-e844a44b29b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:56.142384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6a2ee-e99a-4833-b8b7-e844a44b29b6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e3a6a2ee-e99a-4833-b8b7-e844a44b29b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:56.153837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:56.154715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 301/600] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42780dd5-84bd-45d0-b456-6a3b237031a6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.161450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42780dd5-84bd-45d0-b456-6a3b237031a6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.162121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42780dd5-84bd-45d0-b456-6a3b237031a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.174824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-42780dd5-84bd-45d0-b456-6a3b237031a6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:56.176030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42780dd5-84bd-45d0-b456-6a3b237031a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:56.183522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:56.220288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781306be-bbbc-4eb4-90f4-d040218af05a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:56.253052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 302/601] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:56.253052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42780dd5-84bd-45d0-b456-6a3b237031a6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.277693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:56.279385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.279853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.280552 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.298794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:56.301986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:56.323191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:56.324176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:56.325090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:56.325090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:56.325090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:56.332073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 300/602] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:56.332073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.352940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:56.383136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42780dd5-84bd-45d0-b456-6a3b237031a6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:56.422995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11d9bc-f953-4d6b-b8df-e90e435534bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:56.423970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d9bc-f953-4d6b-b8df-e90e435534bd None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.424406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d9bc-f953-4d6b-b8df-e90e435534bd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.424807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d9bc-f953-4d6b-b8df-e90e435534bd None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/f401923fe84446b9962e854f1fc2bed3/roles/473c27c2658941c492c7a8b45c37dddc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.443189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11d9bc-f953-4d6b-b8df-e90e435534bd None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=f401923fe84446b9962e854f1fc2bed3, role_id=473c27c2658941c492c7a8b45c37dddc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:56.444844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11d9bc-f953-4d6b-b8df-e90e435534bd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:56.462964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 303/603] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:56 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/f401923fe84446b9962e854f1fc2bed3/roles/473c27c2658941c492c7a8b45c37dddc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:56.464243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11d9bc-f953-4d6b-b8df-e90e435534bd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.474710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb758c-6ed8-47e5-bd21-2e15e47a0f3e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:56.505725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:56.535024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:56.535651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.535971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.536444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.537125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:56.537555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:56.540070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:56.574164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 301/604] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:56.580570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.610275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11d9bc-f953-4d6b-b8df-e90e435534bd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:56.653057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:56.658461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:56.659637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.660139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.660621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.661851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:56.662399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:56.664616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:56.681054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 304/605] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:56.682295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.740844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410f5ff-469c-4c7f-926e-6ee7e4b533fa None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:56.782759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec134e96-6dc7-4517-bcf3-3a4783c3f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:56.783431 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec134e96-6dc7-4517-bcf3-3a4783c3f45f None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.783715 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec134e96-6dc7-4517-bcf3-3a4783c3f45f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.783994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec134e96-6dc7-4517-bcf3-3a4783c3f45f None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/945f11bdc38e4728a78449d99a0fcbdc/roles/473c27c2658941c492c7a8b45c37dddc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.800188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec134e96-6dc7-4517-bcf3-3a4783c3f45f None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=945f11bdc38e4728a78449d99a0fcbdc, role_id=473c27c2658941c492c7a8b45c37dddc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:56.801942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec134e96-6dc7-4517-bcf3-3a4783c3f45f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:56.818630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 302/606] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:56 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/945f11bdc38e4728a78449d99a0fcbdc/roles/473c27c2658941c492c7a8b45c37dddc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:56.819571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec134e96-6dc7-4517-bcf3-3a4783c3f45f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.819972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d32d50-b96a-4fca-b09e-39cb6a04960d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:56.861648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f99a-3de6-481d-a9a2-22f38c0b9fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:56.862455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f99a-3de6-481d-a9a2-22f38c0b9fbd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:56.862860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f99a-3de6-481d-a9a2-22f38c0b9fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:56.863206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f99a-3de6-481d-a9a2-22f38c0b9fbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:56.878877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62f99a-3de6-481d-a9a2-22f38c0b9fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:56.881079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fa62f99a-3de6-481d-a9a2-22f38c0b9fbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:56.885454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:56.886645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:56.887676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:56.889504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 305/607] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:56.894737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f99a-3de6-481d-a9a2-22f38c0b9fbd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:56.960733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:57.024278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f99a-3de6-481d-a9a2-22f38c0b9fbd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:57.063821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec134e96-6dc7-4517-bcf3-3a4783c3f45f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:57.069227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:57.069966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.070326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.070678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:57.071442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:57.071824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:57.073783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:57.086774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 306/608] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:57.092131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:57.108751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:57.109681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.109965 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.110238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:57.121550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:57.123347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:57.143026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:57.144064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:57.144962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 303/609] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:57.152999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:57.226066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed799c2-ea33-4010-b51e-a7c79cc53cd9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:57.243132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:57.297283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:57.298338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.298826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.299300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:57.311356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:57.313835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433265-96ac-4d6d-ab2c-6153aa502376 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:57.322526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:57.324657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:57.356089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:57.357528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:57.358448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:57.358448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:57.358448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:57.358448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 307/610] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:08:57.363627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:57.386324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:57.387303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.387824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.388292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:57.389193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:57.389722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:57.391391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:57.412971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 304/611] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:57.418989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:57.527710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b32b8-a862-4eb3-b6dc-40aba2a6a367 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:57.575099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:57.575710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.575993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.576265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:57.576923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:57.577230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:57.578639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:57.587176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52837197-2daf-4ac1-8b03-e77d8330acba None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:57.605169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 308/612] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:57.611746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:57.655385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:57.661117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2d58-875d-4e55-929f-394db7a88b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:57.661835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2d58-875d-4e55-929f-394db7a88b53 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.662137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2d58-875d-4e55-929f-394db7a88b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.662386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2d58-875d-4e55-929f-394db7a88b53 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/c8bc6ac1df7f4bd383fded2b9a22ecf3/roles/473c27c2658941c492c7a8b45c37dddc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:57.681907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa2d58-875d-4e55-929f-394db7a88b53 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=c8bc6ac1df7f4bd383fded2b9a22ecf3, role_id=473c27c2658941c492c7a8b45c37dddc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:57.683425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa2d58-875d-4e55-929f-394db7a88b53 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:57.708705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 305/613] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:57 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/c8bc6ac1df7f4bd383fded2b9a22ecf3/roles/473c27c2658941c492c7a8b45c37dddc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:08:57.770586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cff4c-d2a5-4d39-9011-d228b96f1bda None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:57.811143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ff912-49e4-4556-8d6a-1023894e5c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:57.811793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff912-49e4-4556-8d6a-1023894e5c0c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.812074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff912-49e4-4556-8d6a-1023894e5c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.812348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff912-49e4-4556-8d6a-1023894e5c0c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:57.821941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ff912-49e4-4556-8d6a-1023894e5c0c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:57.823415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ff912-49e4-4556-8d6a-1023894e5c0c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-869ff912-49e4-4556-8d6a-1023894e5c0c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:57.843306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:57.844330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:08:57.845292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:57.846357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 309/614] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:08:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:57.851709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2d58-875d-4e55-929f-394db7a88b53 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:57.866550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:57.953583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7683d3-abe5-4c5d-8785-2218e7028895 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.953768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7683d3-abe5-4c5d-8785-2218e7028895 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.954043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7683d3-abe5-4c5d-8785-2218e7028895 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:57.957213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 310/615] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:57.963703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed903b-9042-418f-b985-814883707af0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:57.964104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed903b-9042-418f-b985-814883707af0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:57.964379 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed903b-9042-418f-b985-814883707af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:58.001522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-96ed903b-9042-418f-b985-814883707af0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:58.003358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-96ed903b-9042-418f-b985-814883707af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:58.031713 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2d58-875d-4e55-929f-394db7a88b53 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:58.072662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:58.073272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:58.073584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:58.073877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:58.074613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:58.074914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:58.076340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:58.098002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 306/616] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Oct 6 12:08:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:58.105581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:58.105758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 311/617] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:58.173902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:58.213244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48cb96-239c-4454-b2ac-0f3005aaee46 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:58.248392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:58.249031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:58.249608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:58.249884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:58.260675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:58.262164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:58.277901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:58.278895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:58.279782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:58.279782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:58.279782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:58.279782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 307/618] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:58.286334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed903b-9042-418f-b985-814883707af0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:58.307716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:58.432140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed903b-9042-418f-b985-814883707af0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:58.496236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:58.497233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:58.497769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:58.498268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:58.499131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:58.499634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:58.501227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:58.526388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 312/619] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:58.535179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:58.555936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:58.709924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:58.732144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c9cd2-8ea6-4940-8efa-d9fe4775bf0c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:58.758817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048370c9-5a96-4582-a899-c00a074f2fe3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:58.766576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:58.809292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:58.810305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:58.811467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:58.812573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:58.827896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:58.829572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:58.838418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e34f-8f44-4803-a653-ead892198c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:58.839064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e34f-8f44-4803-a653-ead892198c4f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:58.839340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e34f-8f44-4803-a653-ead892198c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:58.839611 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e34f-8f44-4803-a653-ead892198c4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:08:58.849449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:58.850417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:58.851302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:08:58.851302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:08:58.851302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:08:58.851302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:08:58.851302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:08:58.851302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:08:58.851302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:08:58.851302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:58.851740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 308/620] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:58.858864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:58.864222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097e34f-8f44-4803-a653-ead892198c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6097e34f-8f44-4803-a653-ead892198c4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:58.870760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:58.871695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:58.872519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:58.875145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 313/621] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:58.881264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e34f-8f44-4803-a653-ead892198c4f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:59.071802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a395e14-4a6b-4827-b6b8-47b486826567 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:59.077750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e34f-8f44-4803-a653-ead892198c4f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:59.117454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:59.122803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d4f5d-dadb-4cce-afd2-ace254a61dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:59.123869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d4f5d-dadb-4cce-afd2-ace254a61dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.124424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d4f5d-dadb-4cce-afd2-ace254a61dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.124947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d4f5d-dadb-4cce-afd2-ace254a61dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.125960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d4f5d-dadb-4cce-afd2-ace254a61dc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:59.126580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d4f5d-dadb-4cce-afd2-ace254a61dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:59.129041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d4f5d-dadb-4cce-afd2-ace254a61dc0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:59.149931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 314/622] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:59.152021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ea06-5a73-4f3c-b89a-763b7ebe3f48 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.152346 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ea06-5a73-4f3c-b89a-763b7ebe3f48 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.152586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ea06-5a73-4f3c-b89a-763b7ebe3f48 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.153441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae204e11-95a7-498d-a9f7-b4bed97c41b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:59.154374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 315/623] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:59.154866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae204e11-95a7-498d-a9f7-b4bed97c41b8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.154973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ea06-5a73-4f3c-b89a-763b7ebe3f48 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:59.155537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae204e11-95a7-498d-a9f7-b4bed97c41b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.156000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae204e11-95a7-498d-a9f7-b4bed97c41b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.156886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae204e11-95a7-498d-a9f7-b4bed97c41b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:59.157380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae204e11-95a7-498d-a9f7-b4bed97c41b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:59.159898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae204e11-95a7-498d-a9f7-b4bed97c41b8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:59.173998 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 309/624] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:08:59.180704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d4642-37ac-4783-899c-b0c0255c0839 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.181191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d4642-37ac-4783-899c-b0c0255c0839 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.181794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d4642-37ac-4783-899c-b0c0255c0839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.201351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4b8d4642-37ac-4783-899c-b0c0255c0839 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:59.202571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4b8d4642-37ac-4783-899c-b0c0255c0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:59.241639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:59.274423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ea06-5a73-4f3c-b89a-763b7ebe3f48 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:59.293787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 310/625] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:59.295045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d4642-37ac-4783-899c-b0c0255c0839 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:59.311560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:59.312194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.312474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.312745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.325326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:59.326397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:08:59.342531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:59.343541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:08:59.344455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:08:59.344455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:08:59.344455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:59.344455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 316/626] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:59.354399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:59.435593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:59.498930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d4642-37ac-4783-899c-b0c0255c0839 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:59.511543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce050b-c971-43e8-aafa-5bff0158a173 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:59.551249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f748b2a-5b65-4121-bb8e-659a153a261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:59.551875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f748b2a-5b65-4121-bb8e-659a153a261a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.552159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f748b2a-5b65-4121-bb8e-659a153a261a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.552432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f748b2a-5b65-4121-bb8e-659a153a261a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.553190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f748b2a-5b65-4121-bb8e-659a153a261a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:08:59.553494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f748b2a-5b65-4121-bb8e-659a153a261a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:59.553770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47353d3d-5d83-4fe0-abe3-8f0f7f3ba2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:59.554933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47353d3d-5d83-4fe0-abe3-8f0f7f3ba2d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.555139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f748b2a-5b65-4121-bb8e-659a153a261a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:59.555507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47353d3d-5d83-4fe0-abe3-8f0f7f3ba2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.555916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47353d3d-5d83-4fe0-abe3-8f0f7f3ba2d1 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/158a2959940b40378234c1ae5e566c97/roles/473c27c2658941c492c7a8b45c37dddc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.570313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 317/627] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:08:59.574886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47353d3d-5d83-4fe0-abe3-8f0f7f3ba2d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=158a2959940b40378234c1ae5e566c97, role_id=473c27c2658941c492c7a8b45c37dddc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:59.575973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7622f-45c9-4e4f-ad45-2ece996100f2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.576205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7622f-45c9-4e4f-ad45-2ece996100f2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.576483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7622f-45c9-4e4f-ad45-2ece996100f2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.577188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47353d3d-5d83-4fe0-abe3-8f0f7f3ba2d1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:59.578028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 318/628] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:08:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:08:59.578742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7622f-45c9-4e4f-ad45-2ece996100f2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:59.592880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 311/629] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:08:59 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/158a2959940b40378234c1ae5e566c97/roles/473c27c2658941c492c7a8b45c37dddc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:08:59.594146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec404a1f-7eb7-4ff8-aaaa-84b245e446eb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.594432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec404a1f-7eb7-4ff8-aaaa-84b245e446eb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.594709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec404a1f-7eb7-4ff8-aaaa-84b245e446eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.615241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ec404a1f-7eb7-4ff8-aaaa-84b245e446eb None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:08:59.616462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ec404a1f-7eb7-4ff8-aaaa-84b245e446eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:08:59.635160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:59.716192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 312/630] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:08:59.717080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec404a1f-7eb7-4ff8-aaaa-84b245e446eb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:59.756969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7622f-45c9-4e4f-ad45-2ece996100f2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:59.769006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:08:59.806938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:59.807609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.807887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.808162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.818022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:08:59.819553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:08:59.834662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:59.835855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:08:59.837029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 319/631] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:08:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:59.843823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:59.910125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec404a1f-7eb7-4ff8-aaaa-84b245e446eb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:59.958595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4281-e651-4d32-8773-8e528fa09859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:08:59.959517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4281-e651-4d32-8773-8e528fa09859 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:08:59.959792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4281-e651-4d32-8773-8e528fa09859 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:08:59.960220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4281-e651-4d32-8773-8e528fa09859 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:08:59.966429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cf942-26ea-4c2c-93bc-44c1f48ac037 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:08:59.974052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4281-e651-4d32-8773-8e528fa09859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-dd6b4281-e651-4d32-8773-8e528fa09859 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:08:59.980387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:08:59.981345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:08:59.982228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:08:59.982859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 313/632] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:08:59.988893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4281-e651-4d32-8773-8e528fa09859 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:08:59.993210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:00.009662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.010336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.010622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.010901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.011796 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:00.012109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:00.013678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:00.033702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 320/633] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:08:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:00.045901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:00.076550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:00.122084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4281-e651-4d32-8773-8e528fa09859 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:00.158688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.160234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.160544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.161021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.161932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:00.162410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:00.163883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:00.182764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572e1ad-bef7-441d-a1e3-432a027dfa07 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:00.185110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 314/634] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:08:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:00.191692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:00.227246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032842cc-612b-402a-be0b-f8bde5bc76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.228222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032842cc-612b-402a-be0b-f8bde5bc76b1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.228709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032842cc-612b-402a-be0b-f8bde5bc76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.229183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032842cc-612b-402a-be0b-f8bde5bc76b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.272529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:00.309782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059a762-bf6c-4cee-bc40-c06d2fcd0751 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:00.313368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032842cc-612b-402a-be0b-f8bde5bc76b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:00.315242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032842cc-612b-402a-be0b-f8bde5bc76b1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:00.345934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:00.359932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.360902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.361200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.361476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.377441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:00.379229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:00.399224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:00.400248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:00.401439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:00.401439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:00.401439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:00.403796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 315/635] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:00.404981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:00.448704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 321/636] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:09:00.450295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032842cc-612b-402a-be0b-f8bde5bc76b1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:00.545547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574f5c-9a77-442e-8e09-ed4a426de472 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:00.564641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:00.576005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032842cc-612b-402a-be0b-f8bde5bc76b1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:00.584305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b873ffb-a150-45c2-b749-5669a5f7a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.584939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b873ffb-a150-45c2-b749-5669a5f7a966 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.585218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b873ffb-a150-45c2-b749-5669a5f7a966 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.585482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b873ffb-a150-45c2-b749-5669a5f7a966 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.598348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b873ffb-a150-45c2-b749-5669a5f7a966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:00.602139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6b873ffb-a150-45c2-b749-5669a5f7a966 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:00.604656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:00.605716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 316/637] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:00.607116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b873ffb-a150-45c2-b749-5669a5f7a966 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:00.619325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546c9f7-4d7a-45fe-b827-731d47a93684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.620163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c9f7-4d7a-45fe-b827-731d47a93684 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.620443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c9f7-4d7a-45fe-b827-731d47a93684 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.620712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c9f7-4d7a-45fe-b827-731d47a93684 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.621361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c9f7-4d7a-45fe-b827-731d47a93684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:00.621767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c9f7-4d7a-45fe-b827-731d47a93684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:00.623122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c9f7-4d7a-45fe-b827-731d47a93684 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:00.636709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 322/638] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:00.638001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9101-f4eb-47fd-96b4-f377301877c8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.638291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9101-f4eb-47fd-96b4-f377301877c8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.638571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9101-f4eb-47fd-96b4-f377301877c8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.644109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 323/639] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:00.644109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9101-f4eb-47fd-96b4-f377301877c8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:00.725673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b873ffb-a150-45c2-b749-5669a5f7a966 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:00.751797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9101-f4eb-47fd-96b4-f377301877c8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:00.760698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.761330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.761638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.761914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.772923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:00.774410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:00.789813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:00.790803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:00.791695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:00.791695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:00.791695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:00.791695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 317/640] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:00.791695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:00.793047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9600c4-9abb-4ae0-bd54-e03c0e1e6645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.793690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9600c4-9abb-4ae0-bd54-e03c0e1e6645 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.793975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9600c4-9abb-4ae0-bd54-e03c0e1e6645 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.794248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9600c4-9abb-4ae0-bd54-e03c0e1e6645 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.794924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9600c4-9abb-4ae0-bd54-e03c0e1e6645 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:00.795365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9600c4-9abb-4ae0-bd54-e03c0e1e6645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:00.796736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9600c4-9abb-4ae0-bd54-e03c0e1e6645 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:00.811669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 324/641] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:00.811669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5894-964f-462c-8af7-d3a8abeb9163 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.811669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5894-964f-462c-8af7-d3a8abeb9163 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.811669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5894-964f-462c-8af7-d3a8abeb9163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.828846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-90db5894-964f-462c-8af7-d3a8abeb9163 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:00.830290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-90db5894-964f-462c-8af7-d3a8abeb9163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:00.832232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:00.879835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:00.903744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ecd3e-bc6e-44e4-bba0-c8c0242a3dc2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:00.906277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 325/642] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:09:00.907163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5894-964f-462c-8af7-d3a8abeb9163 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:00.953380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:00.954159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:00.954357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:00.954591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:00.963995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:00.965595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:00.984585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:00.985632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 12:09:00.986576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:00.987619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 318/643] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:00.992523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.033039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5894-964f-462c-8af7-d3a8abeb9163 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.075150 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.076021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.076366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.076645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.077957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:01.078275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.079660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.095092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 326/644] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:01.097058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.133184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:01.144325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:01.148699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8321f-2b5b-4d19-b653-1bcd7efb634a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.198983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.199539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.199816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.200088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.215456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.217571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.222193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a08f7-7d2a-4ce9-a7dc-18b3d115462a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:01.236547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:01.238213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:01.239911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:01.239911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:01.239911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:01.239911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 319/645] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:01.239911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.263394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.264005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.264287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.264564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.265300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:01.265635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.267054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.289586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 327/646] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:01.289586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.358325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c367a8-bfa8-4258-af68-5e1d2ca090c8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.392107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:01.395767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.396424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.396711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.396986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.400193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ee1ab-5157-4e73-a6ca-0c670cd08631 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.404692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.406286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:01.418865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:01.419850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:01.420769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:01.420769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:01.420769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:01.420769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:01.420769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:01.420769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:01.420769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:01.420769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:01.425260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 320/647] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:01.426130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.428990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:01.442684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797224-322e-4f69-a153-18ddac8dfbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.443329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797224-322e-4f69-a153-18ddac8dfbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.443610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797224-322e-4f69-a153-18ddac8dfbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.443885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797224-322e-4f69-a153-18ddac8dfbf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.454745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93797224-322e-4f69-a153-18ddac8dfbf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-93797224-322e-4f69-a153-18ddac8dfbf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:01.460644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:01.461617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 328/648] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:01.466540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797224-322e-4f69-a153-18ddac8dfbf3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.536712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cdb13-128b-45da-a78c-4cd0fa155f75 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.573708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.574369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.574598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.574740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797224-322e-4f69-a153-18ddac8dfbf3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.574918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.575491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:01.575790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.577173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.593573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 321/649] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:01.593573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.617969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17397e1-ec47-417c-b269-02f3adb08d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.618693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17397e1-ec47-417c-b269-02f3adb08d7b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.618976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17397e1-ec47-417c-b269-02f3adb08d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.619368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17397e1-ec47-417c-b269-02f3adb08d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.647178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:01.653736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:01.693429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d9ca7-f7b5-4283-8622-1790198a377c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.697851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17397e1-ec47-417c-b269-02f3adb08d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.699389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17397e1-ec47-417c-b269-02f3adb08d7b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.730830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.731357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.731637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.732105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.732599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:01.732944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.734368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.752236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 322/650] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:01.752236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.814232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 329/651] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:09:01.815175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17397e1-ec47-417c-b269-02f3adb08d7b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.860791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa6ae7-45d6-4ec3-942c-1b67a29a24dc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.875846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:01.886353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:01.899587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.900223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.900821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.901099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.901873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:01.902146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.903578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.913654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 323/652] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:01.918640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:01.933691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17397e1-ec47-417c-b269-02f3adb08d7b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:01.973212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:01.974041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:01.974574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:01.974705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:01.982407 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:01.983938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:01.996288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:01.997490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 06 12:09:01.998766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:02.004047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 330/653] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:02.004047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.030666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6c776-53a8-45ff-82f7-a7747abac993 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.064368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.064976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.065905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.066184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.067010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=1bd257708357455d99990b01af81e5b0) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:02.067326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.068762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.074482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 324/654] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/role_assignments?user.id=1bd257708357455d99990b01af81e5b0&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:02.082008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.110734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564cff-4646-4789-b243-7e95cbbaaf32 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.126288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:02.147282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:02.156370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.157596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.158059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.159059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.177331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.179136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:02.199007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:02.200030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:02.207467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:02.207467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:02.207467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:02.207467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 331/655] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:02.207467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.220318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79869-0d72-44a9-8fc5-9020c0ab9e7f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.265621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00220315-2dc6-41a6-a261-71141bb04bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.266450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220315-2dc6-41a6-a261-71141bb04bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.266450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220315-2dc6-41a6-a261-71141bb04bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.266728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220315-2dc6-41a6-a261-71141bb04bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.281282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00220315-2dc6-41a6-a261-71141bb04bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.282805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00220315-2dc6-41a6-a261-71141bb04bf7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-00220315-2dc6-41a6-a261-71141bb04bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:02.298705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:02.299841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:02.300767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:02.300767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:02.300767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:02.300767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 325/656] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:02.301569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad46dca-bccc-4efe-af5e-513b0660b62e None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.301569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad46dca-bccc-4efe-af5e-513b0660b62e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.301912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad46dca-bccc-4efe-af5e-513b0660b62e None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.304368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 326/657] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:02.304597 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad46dca-bccc-4efe-af5e-513b0660b62e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.327058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4b73e-0e41-44b2-8336-ef99d56a0833 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.363942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.364676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.364962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.365239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.366016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:02.366327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.367901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.392621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 332/658] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:02.392621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.417610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:02.421810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:02.426842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad46dca-bccc-4efe-af5e-513b0660b62e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.463086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d1dbb-b30c-4f4c-87b5-c834d8218124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.463930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1dbb-b30c-4f4c-87b5-c834d8218124 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.464351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1dbb-b30c-4f4c-87b5-c834d8218124 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.464872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1dbb-b30c-4f4c-87b5-c834d8218124 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.465819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d1dbb-b30c-4f4c-87b5-c834d8218124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:02.466116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d1dbb-b30c-4f4c-87b5-c834d8218124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.467502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d1dbb-b30c-4f4c-87b5-c834d8218124 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.485207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 327/659] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:02.485207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2a1c1-d4db-445a-88cd-006e74ca6beb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.485207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2a1c1-d4db-445a-88cd-006e74ca6beb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.485207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2a1c1-d4db-445a-88cd-006e74ca6beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.499634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e26fd-35c1-4585-a360-02a6598e8d7e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.501441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9ae2a1c1-d4db-445a-88cd-006e74ca6beb None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:02.503003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9ae2a1c1-d4db-445a-88cd-006e74ca6beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:02.535408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.535940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.536224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.536498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.537148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:02.537454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.538877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.555679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 333/660] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:02.555679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.589820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 328/661] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:09:02.589820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2a1c1-d4db-445a-88cd-006e74ca6beb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.661358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:02.692132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0067f-456a-47ac-90c0-86677e7d2623 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.717708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:02.729067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2a1c1-d4db-445a-88cd-006e74ca6beb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.730046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f62bbd-5c79-43bb-a3bc-1826ded3e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.730661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62bbd-5c79-43bb-a3bc-1826ded3e9ad None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.730946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62bbd-5c79-43bb-a3bc-1826ded3e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.731222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62bbd-5c79-43bb-a3bc-1826ded3e9ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.767974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.769590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.770068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.770559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.778610 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.780570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:02.793672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:02.794627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:02.795501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:02.795501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:02.795501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:02.795501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:02.795501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:02.795501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:02.795501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:02.795501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:02.798161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 329/662] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:02.799147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.808502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f62bbd-5c79-43bb-a3bc-1826ded3e9ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.810722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f62bbd-5c79-43bb-a3bc-1826ded3e9ad None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.902759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:02.912606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9b9c-5ffb-430c-a8f3-6b0e6cad9ee6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:02.920967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 334/663] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:09:02.921835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f62bbd-5c79-43bb-a3bc-1826ded3e9ad None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.955903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:02.956613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:02.956894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:02.957162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:02.965152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:02.966626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:02.978781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:02.979783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 330/664] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:02.980733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:02.997290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:03.048437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f62bbd-5c79-43bb-a3bc-1826ded3e9ad None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.084631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.085238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.085567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.085827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.086508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:03.086816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:03.088237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:03.097631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9345f6-dcaa-4f21-b6e4-643358533728 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.105307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 335/665] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:03.106255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.136758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6b443-584a-4023-b21f-3cc31ef24ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.137390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b443-584a-4023-b21f-3cc31ef24ead None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.137704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b443-584a-4023-b21f-3cc31ef24ead None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.137974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b443-584a-4023-b21f-3cc31ef24ead None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.148786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6b443-584a-4023-b21f-3cc31ef24ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f9d6b443-584a-4023-b21f-3cc31ef24ead None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:03.155139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:03.156095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:03.156947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 331/666] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:03.157717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6b443-584a-4023-b21f-3cc31ef24ead None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.163942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:03.224102 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511432d-f910-49af-88d8-961a62b341f8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.231908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:03.262200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.262904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.263194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.263482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.268439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6b443-584a-4023-b21f-3cc31ef24ead None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.275338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:03.277066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:03.293689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:03.294683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:03.295590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:03.295590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:03.295590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:03.295590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 336/667] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:03.295590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.308751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.309341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.309592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.309870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.310606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:03.310912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:03.312353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:03.331225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 332/668] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:03.331977 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.403772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:03.410055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a5e47-7b15-4dad-8b51-cbb954def509 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.445937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1829-51ce-4c9d-9d0c-b1c286566d22 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.450019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.450837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.451299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.451752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.452687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=f401923fe84446b9962e854f1fc2bed3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:03.453190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:03.455303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:03.464916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 337/669] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/role_assignments?user.id=f401923fe84446b9962e854f1fc2bed3&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:03.465876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.486578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:03.500763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.501818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.503347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.504073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.504981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:03.505382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:03.508204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:03.520856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 333/670] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:03.522181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.585002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aa22b-2b4a-49be-9c5e-f2e1adc13b82 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.624459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.625304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.625688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.626034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.626801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:03.627338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:03.629741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:03.647972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 338/671] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:03.649283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.651607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a2a8-ca17-463a-b389-ef84baecb662 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.673839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:03.695203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ab81c-fb8d-45e3-ade0-c8711a4b81ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.695928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab81c-fb8d-45e3-ade0-c8711a4b81ab None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.696294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab81c-fb8d-45e3-ade0-c8711a4b81ab None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.696632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab81c-fb8d-45e3-ade0-c8711a4b81ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.764950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:03.783258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ab81c-fb8d-45e3-ade0-c8711a4b81ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:03.785619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c399a5-f7e7-4cdf-ac06-dedbcb3b94a7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:03.785915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ab81c-fb8d-45e3-ade0-c8711a4b81ab None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:03.829791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:03.831009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:03.831417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:03.832020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:03.843209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:03.844719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:03.862445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:03.863706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:03.864791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:03.864791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:03.864791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:03.871225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 339/672] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:03.872551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.922340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 334/673] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:09:03.923410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ab81c-fb8d-45e3-ade0-c8711a4b81ab None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:03.962201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:03.998970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030aa0e-60cb-4e4f-bf7a-84843e1ef75a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.037952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.038772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.039151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.039596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.043206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:04.051923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.052625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.059414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ab81c-fb8d-45e3-ade0-c8711a4b81ab None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:04.065806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:04.067002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:04.068073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:04.068073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:04.068073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:04.068073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:04.068073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:04.068073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:04.068073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:04.068073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:04.071709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 340/674] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:04.072595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.101397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.102109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.102486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.102941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.103704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:04.104143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.105844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.125867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 335/675] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:04.126932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.204943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c57e5-8c32-4db0-934c-8f36b3cc91b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.240083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:04.247696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.248363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.248647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.248924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.267175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.271266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.286284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88eaf5-9bf6-4ed1-b8ce-cb84ee4236c5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:04.287361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:04.289425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:04.291620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:04.291620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:04.291620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:04.291620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 341/676] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:04.291620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.327811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.328868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.329647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.329929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.331003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:04.331368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.333673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.353717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 336/677] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:04.354531 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.369195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:04.423923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952f15a-1bbe-4f53-8120-f16799c17a8c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.462285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.462919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.463208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.463491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.465907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8882-9ec3-4346-9edd-94a117cdb6e6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.472264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.473774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:04.486047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:04.487173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:04.488416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 342/678] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:04.489034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.508757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdddc1-f27d-4a46-894b-95e47fc8cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.510081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdddc1-f27d-4a46-894b-95e47fc8cffc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.510466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdddc1-f27d-4a46-894b-95e47fc8cffc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.510810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdddc1-f27d-4a46-894b-95e47fc8cffc None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.511453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdddc1-f27d-4a46-894b-95e47fc8cffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:04.511754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdddc1-f27d-4a46-894b-95e47fc8cffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.513112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdddc1-f27d-4a46-894b-95e47fc8cffc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.530242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 337/679] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:04.530242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298647ec-fd8a-4a69-b445-f46bfbbbb4d8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.530242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298647ec-fd8a-4a69-b445-f46bfbbbb4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.530242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298647ec-fd8a-4a69-b445-f46bfbbbb4d8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.530242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 338/680] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:04.530242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298647ec-fd8a-4a69-b445-f46bfbbbb4d8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.548794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:04.606926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:04.610174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1f0d-a424-4ab2-a3da-1e2edd988af1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.645154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298647ec-fd8a-4a69-b445-f46bfbbbb4d8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.649578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.650192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.650729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.651000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.651727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=945f11bdc38e4728a78449d99a0fcbdc) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:04.652032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.653448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.660331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 343/681] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/role_assignments?user.id=945f11bdc38e4728a78449d99a0fcbdc&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:04.661250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.710969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e651b-44c1-443a-a726-c451a06a443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.711720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e651b-44c1-443a-a726-c451a06a443d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.712004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e651b-44c1-443a-a726-c451a06a443d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.712276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e651b-44c1-443a-a726-c451a06a443d None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.713024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e651b-44c1-443a-a726-c451a06a443d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:04.713329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e651b-44c1-443a-a726-c451a06a443d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.715153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e651b-44c1-443a-a726-c451a06a443d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.750654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 339/682] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:04.750654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd381d-5d31-4743-a44b-eae231f03419 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.750654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd381d-5d31-4743-a44b-eae231f03419 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.750654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd381d-5d31-4743-a44b-eae231f03419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.773258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f0cd381d-5d31-4743-a44b-eae231f03419 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:04.775186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f0cd381d-5d31-4743-a44b-eae231f03419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:04.800713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d2a5-a81c-4e89-af4e-a05322398b11 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.811201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:04.840630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:04.841278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:04.841598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:04.841885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:04.852357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:04.853881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:04.867511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:04.868443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:04.869335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:04.869335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:04.869335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:04.869335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:04.869335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:04.869335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:04.869335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:04.869335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:04.872653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 340/683] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:09:04.873454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 344/684] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:04.873846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd381d-5d31-4743-a44b-eae231f03419 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.874364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:04.945922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:04.983583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094d7a1-b0e8-49b4-9cd1-7f9a307009c1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:04.998730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd381d-5d31-4743-a44b-eae231f03419 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:05.023694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:05.024314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.024601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.024877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.025885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:05.026196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:05.027644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:05.043452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 345/685] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:05.047306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6756c-3143-4b31-860a-4938be9178ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:05.048177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6756c-3143-4b31-860a-4938be9178ea None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.048647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6756c-3143-4b31-860a-4938be9178ea None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.049144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6756c-3143-4b31-860a-4938be9178ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.049800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:05.090756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:05.151887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6756c-3143-4b31-860a-4938be9178ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:05.153686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6756c-3143-4b31-860a-4938be9178ea None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:05.191816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f08685-c74e-4b61-ae5c-6cd438e57573 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:05.220091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:05.238197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:05.238820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.239102 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.239375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.240146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=c8bc6ac1df7f4bd383fded2b9a22ecf3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:05.240457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:05.242504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:05.251459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 346/686] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:05 2022] GET /identity/v3/role_assignments?user.id=c8bc6ac1df7f4bd383fded2b9a22ecf3&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:05.252862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:05.305465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 341/687] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:09:05.313390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6756c-3143-4b31-860a-4938be9178ea None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:05.433656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:05.446201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac8b3-90da-4fdc-b976-7e917b65fab4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:05.491359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a06a5-6f3e-41c0-9556-d5b68a9e7b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:05.492016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a06a5-6f3e-41c0-9556-d5b68a9e7b76 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.492300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a06a5-6f3e-41c0-9556-d5b68a9e7b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.492577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a06a5-6f3e-41c0-9556-d5b68a9e7b76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.506056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a06a5-6f3e-41c0-9556-d5b68a9e7b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9d8a06a5-6f3e-41c0-9556-d5b68a9e7b76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:05.511319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:05.512512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:05.513833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 347/688] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:05.517724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6756c-3143-4b31-860a-4938be9178ea None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:05.519253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a06a5-6f3e-41c0-9556-d5b68a9e7b76 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:05.564117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:05.565769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.566210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.566636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.577867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:05.579707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:05.602231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:05.604104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:05.605016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:05.605016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:05.605016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:05.607646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 342/689] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:05.614343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:05.630550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:05.651909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a06a5-6f3e-41c0-9556-d5b68a9e7b76 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:05.692932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:05.693899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.694416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.694943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.695808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:05.696287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:05.698182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:05.708875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 348/690] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:05.715354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:05.733663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1dedb-28c2-41f2-8554-655473fff35d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:05.734800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:05.776057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:05.776691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.776976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.777252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.777954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:05.778277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:05.779679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:05.795454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 343/691] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:05.806892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:05.849843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b217d-364a-461d-b901-8a6d0a81aede None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:05.892304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726e658-202a-44f3-8d87-26b0c3db85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:05.893593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726e658-202a-44f3-8d87-26b0c3db85dd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.894233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726e658-202a-44f3-8d87-26b0c3db85dd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.894703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726e658-202a-44f3-8d87-26b0c3db85dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.907235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726e658-202a-44f3-8d87-26b0c3db85dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:05.909955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726e658-202a-44f3-8d87-26b0c3db85dd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8726e658-202a-44f3-8d87-26b0c3db85dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:05.927588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:05.928674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:05.930038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:05.930038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:05.930038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:05.932001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 349/692] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:05.933420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad66d2-9ed6-4c8f-a5ec-dd7ea11a94ee None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:05.937873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad66d2-9ed6-4c8f-a5ec-dd7ea11a94ee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:05.939248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad66d2-9ed6-4c8f-a5ec-dd7ea11a94ee None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:05.941440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 350/693] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:05.943040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad66d2-9ed6-4c8f-a5ec-dd7ea11a94ee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:05.961935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:06.008535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4232f-85db-4e55-b303-3871257f3dd2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:06.030935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:06.059630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36756c-37e6-4d67-b2eb-9cb0ca9b8faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:06.060293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36756c-37e6-4d67-b2eb-9cb0ca9b8faa None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.060575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36756c-37e6-4d67-b2eb-9cb0ca9b8faa None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.060851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36756c-37e6-4d67-b2eb-9cb0ca9b8faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.072826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36756c-37e6-4d67-b2eb-9cb0ca9b8faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:06.074467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36756c-37e6-4d67-b2eb-9cb0ca9b8faa None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:06.074783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad66d2-9ed6-4c8f-a5ec-dd7ea11a94ee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6e36756c-37e6-4d67-b2eb-9cb0ca9b8faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:06.093217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:06.094274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 344/694] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298157e-a576-4575-b0ed-e234e7941591 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.100787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298157e-a576-4575-b0ed-e234e7941591 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.101432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298157e-a576-4575-b0ed-e234e7941591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.124699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:06.125398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a298157e-a576-4575-b0ed-e234e7941591 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:06.125927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.126387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.126911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a298157e-a576-4575-b0ed-e234e7941591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:06.127023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.128477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:06.128971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:06.130899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:06.157711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 351/695] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:06.157711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:06.241651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 345/696] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:09:06.241651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298157e-a576-4575-b0ed-e234e7941591 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:06.313524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:06.343812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38376-fdad-49eb-a0bc-3ccfd392bb56 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:06.368935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298157e-a576-4575-b0ed-e234e7941591 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:06.414272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:06.414955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:06.415286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.415553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.415830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.426968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:06.428595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:06.433076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:06.434072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.434550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.435014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.435918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:06.436419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:06.438138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:06.443142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:06.444107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:06.445041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 346/697] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:09:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:06.454835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:06.460712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 352/698] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:06.467050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:06.648053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7c71f-606f-4298-bb4d-00b80ebcb4f0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:06.659149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbe648-9aea-46f9-9602-34f996d280ed None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:06.682001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:06.690684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:06.691613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.691986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.692350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.693205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:06.694113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:06.695507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:06.712264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:06.714383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.715574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.716014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.716956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=158a2959940b40378234c1ae5e566c97) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:06.717420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:06.719069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:06.721842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 347/699] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:09:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:06.722884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:06.727420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 353/700] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:06 2022] GET /identity/v3/role_assignments?user.id=158a2959940b40378234c1ae5e566c97&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:06.734959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:06.869260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:06.915890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac0e0a-448b-4119-aa14-37d868f64360 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:06.945405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d18fc-3ce2-484b-a23e-a3ed072c84ca None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:06.969443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:06.970422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.971331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.971983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.973104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:06.975035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:06.982857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fa287-e914-432b-8fc1-faa1115398de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:06.983474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fa287-e914-432b-8fc1-faa1115398de None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:06.983768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fa287-e914-432b-8fc1-faa1115398de None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:06.984033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fa287-e914-432b-8fc1-faa1115398de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:06.994309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:06.996065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:06.998327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:07.000850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 348/701] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Oct 6 12:09:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:07.005625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:07.059336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:07.060504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fa287-e914-432b-8fc1-faa1115398de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:07.062145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fa287-e914-432b-8fc1-faa1115398de None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:07.128302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:07.147741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee96da-15f9-4bc9-9dc4-dce634112737 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:07.189876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 354/702] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:09:07.195948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fa287-e914-432b-8fc1-faa1115398de None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:07.196261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:07.196884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:07.197164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:07.197491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:07.198340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:07.198696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:07.201200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:07.209635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 349/703] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Oct 6 12:09:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:07.218577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:07.332897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fa287-e914-432b-8fc1-faa1115398de None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:07.338139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a4888-a4a1-43a7-b017-9c005709be7a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:07.347577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:07.384275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:07.384938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:07.385228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:07.385514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:07.399962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:07.401852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:07.403918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:07.404546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:07.404828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:07.405112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:07.405857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:07.406169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:07.407665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:07.419933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 350/704] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Oct 6 12:09:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:07.426741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:07.427755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:07.428667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:07.428667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:07.428667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:07.428667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 355/705] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:07.433766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:07.613305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e089b9-27c4-49b6-a354-74fe94d7ced0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:07.652905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d16678-bd53-4cd9-bef5-1389305aae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:07.653566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16678-bd53-4cd9-bef5-1389305aae4e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:07.653851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16678-bd53-4cd9-bef5-1389305aae4e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:07.654207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16678-bd53-4cd9-bef5-1389305aae4e None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:07.654886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d16678-bd53-4cd9-bef5-1389305aae4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:07.655186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d16678-bd53-4cd9-bef5-1389305aae4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:07.656572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d16678-bd53-4cd9-bef5-1389305aae4e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:07.675727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 351/706] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:07.681405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:07.686381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:07.701329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2592-69d0-4358-a77e-eb5ca165b968 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:07.701661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2592-69d0-4358-a77e-eb5ca165b968 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:07.701919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2592-69d0-4358-a77e-eb5ca165b968 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:07.703556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 352/707] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:07.709867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef6b7-ff28-4522-9e30-a95598ac71de None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:07.710146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef6b7-ff28-4522-9e30-a95598ac71de None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:07.710421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef6b7-ff28-4522-9e30-a95598ac71de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:07.738165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9b7ef6b7-ff28-4522-9e30-a95598ac71de None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:07.739424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9b7ef6b7-ff28-4522-9e30-a95598ac71de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:07.777078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:07.841917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 353/708] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:09:07.848156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba29f8-8f8b-45dd-86c1-cdd2887046c8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:07.900725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4990602-739f-40aa-b3eb-3196649afa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:07.901782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4990602-739f-40aa-b3eb-3196649afa20 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:07.902282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4990602-739f-40aa-b3eb-3196649afa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:07.902756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4990602-739f-40aa-b3eb-3196649afa20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:07.913774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4990602-739f-40aa-b3eb-3196649afa20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:07.915611 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4990602-739f-40aa-b3eb-3196649afa20 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d4990602-739f-40aa-b3eb-3196649afa20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:07.936370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:07.937370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:07.942897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:07.942897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:07.942897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:07.942897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:07.942897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:07.942897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:07.942897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:07.942897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:07.945318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 356/709] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:07.954750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ef6b7-ff28-4522-9e30-a95598ac71de None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:08.056338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b101-1c57-424b-bae9-57e325551657 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:08.056626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b101-1c57-424b-bae9-57e325551657 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:08.056912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b101-1c57-424b-bae9-57e325551657 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:08.058902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 357/710] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:08.066737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c438-eebc-4ae3-9599-30dd78fd0db3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:08.066926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c438-eebc-4ae3-9599-30dd78fd0db3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:08.067198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c438-eebc-4ae3-9599-30dd78fd0db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:08.089176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8993c438-eebc-4ae3-9599-30dd78fd0db3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:08.090589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8993c438-eebc-4ae3-9599-30dd78fd0db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:08.140506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ef6b7-ff28-4522-9e30-a95598ac71de None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:08.168421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:08.187447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:08.188227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:08.188611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:08.188984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:08.190243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 358/711] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:09:08.190533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:08.190940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:08.191934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c438-eebc-4ae3-9599-30dd78fd0db3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:08.192647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:08.206556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 354/712] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:08.212494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:08.257100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:08.322199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c438-eebc-4ae3-9599-30dd78fd0db3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:08.364341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:08.365491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:08.366123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:08.366567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:08.379979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:08.381847 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:08.400962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:08.402272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:08.403494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:08.403494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:08.403494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:08.405422 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 359/713] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:08.412719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:08.464828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e891571-b8c7-47b7-87ea-5a459acdd393 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:08.516514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:08.550626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:08.551497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:08.553215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:08.553676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:08.554550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=1bd257708357455d99990b01af81e5b0) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:08.556096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:08.558462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:08.570155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 355/714] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:08 2022] GET /identity/v3/role_assignments?user.id=1bd257708357455d99990b01af81e5b0&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:08.570434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:08.610647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558120-c67c-4f34-a9e4-43f8a1b3c7fc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:08.671046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:08.672164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:08.672683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:08.673185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:08.674697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:08.675307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:08.676953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:08.708823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 360/715] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:08.714954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:08.761773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:08.782616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664dc2f-0bde-4454-9808-4aebfb8f9c0f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:08.830676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:08.831768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:08.832894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:08.833389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:08.834268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:08.836400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:08.849246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:08.850315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:08.851163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:08.854289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 356/716] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:08 2022] GET /identity/v3/services/network => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:08.864181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:08.926463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28470061-bb4b-47a6-8ad5-d4e60d59ec15 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:08.930167 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:08.988416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c68c0-c2fe-4d82-9d44-2d4f37d00c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:08.988953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c68c0-c2fe-4d82-9d44-2d4f37d00c0f None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:08.989268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c68c0-c2fe-4d82-9d44-2d4f37d00c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:08.990826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c68c0-c2fe-4d82-9d44-2d4f37d00c0f None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:08.990826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c68c0-c2fe-4d82-9d44-2d4f37d00c0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:08.991827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c68c0-c2fe-4d82-9d44-2d4f37d00c0f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:09.023833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 361/717] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:09:08 2022] POST /identity/v3/users => generated 254 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:09.074823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb99cc-5d27-4a08-8977-f0b859c0a9d7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:09.122970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d023d9-6fbc-45d0-9c06-e987155d0efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:09.123605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d023d9-6fbc-45d0-9c06-e987155d0efd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:09.123936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d023d9-6fbc-45d0-9c06-e987155d0efd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:09.124215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d023d9-6fbc-45d0-9c06-e987155d0efd None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:09.124880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d023d9-6fbc-45d0-9c06-e987155d0efd None admin] RBAC: Adding query filter params (name=network) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:09.125183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d023d9-6fbc-45d0-9c06-e987155d0efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:09.126788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d023d9-6fbc-45d0-9c06-e987155d0efd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:09.133173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 357/718] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:09.139274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c68c0-c2fe-4d82-9d44-2d4f37d00c0f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:09.253752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c68c0-c2fe-4d82-9d44-2d4f37d00c0f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:09.290090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2688e-e29c-4dd4-b3d9-9ecced119ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:09.290762 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2688e-e29c-4dd4-b3d9-9ecced119ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:09.291049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2688e-e29c-4dd4-b3d9-9ecced119ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:09.291319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2688e-e29c-4dd4-b3d9-9ecced119ac8 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:09.291994 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2688e-e29c-4dd4-b3d9-9ecced119ac8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:09.292294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2688e-e29c-4dd4-b3d9-9ecced119ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:09.293683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2688e-e29c-4dd4-b3d9-9ecced119ac8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:09.300379 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 362/719] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:09.836059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd9b83-9160-4db5-a34b-38826fc195c8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:09.836466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd9b83-9160-4db5-a34b-38826fc195c8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:09.836680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd9b83-9160-4db5-a34b-38826fc195c8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:09.838505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 358/720] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:09.843487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1720-a141-4f0b-a415-e0aa4d40c765 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:09.843948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1720-a141-4f0b-a415-e0aa4d40c765 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:09.844044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1720-a141-4f0b-a415-e0aa4d40c765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:09.866816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-beaf1720-a141-4f0b-a415-e0aa4d40c765 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:09.868106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-beaf1720-a141-4f0b-a415-e0aa4d40c765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:09.894163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:09.949848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 363/721] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 06 12:09:10.432029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd9b83-9160-4db5-a34b-38826fc195c8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:10.450079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:10.531656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545537-3a90-4081-b647-1601f54b998f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:10.531970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545537-3a90-4081-b647-1601f54b998f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:10.532210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545537-3a90-4081-b647-1601f54b998f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:10.534960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 364/722] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:10.545065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df84c1-d079-4d05-a4c4-a9dc7d7dcf26 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:10.545352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df84c1-d079-4d05-a4c4-a9dc7d7dcf26 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:10.545674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df84c1-d079-4d05-a4c4-a9dc7d7dcf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:10.574056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c0df84c1-d079-4d05-a4c4-a9dc7d7dcf26 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:10.576278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c0df84c1-d079-4d05-a4c4-a9dc7d7dcf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:10.598364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd9b83-9160-4db5-a34b-38826fc195c8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:10.667974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a559c93-fc6c-427c-a5fb-704e750f7a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:10.668622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a559c93-fc6c-427c-a5fb-704e750f7a23 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:10.668896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a559c93-fc6c-427c-a5fb-704e750f7a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:10.669165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a559c93-fc6c-427c-a5fb-704e750f7a23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:10.681283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a559c93-fc6c-427c-a5fb-704e750f7a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8a559c93-fc6c-427c-a5fb-704e750f7a23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:10.686756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:10.687687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:10.688516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 359/723] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:10.693893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a559c93-fc6c-427c-a5fb-704e750f7a23 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:10.726545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 365/724] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:09:10.816761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:10.862315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a559c93-fc6c-427c-a5fb-704e750f7a23 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:10.908097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:10.908790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:10.909067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:10.909494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:10.910200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:10.910554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:10.911931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:10.932653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 360/725] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:10.937970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df84c1-d079-4d05-a4c4-a9dc7d7dcf26 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:11.018605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:11.069452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:11.105571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df84c1-d079-4d05-a4c4-a9dc7d7dcf26 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:11.175598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:11.176255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.176537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.176808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.194304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:11.196757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:11.222934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192310f2-5074-4ee9-93a0-116e69aafec3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:11.229073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:11.230562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:11.231991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:11.231991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:11.231991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:11.238747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 366/726] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:11.245106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:11.303556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a33c0-b1cc-45f2-912e-b7c547a76c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:11.304533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a33c0-b1cc-45f2-912e-b7c547a76c57 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.305042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a33c0-b1cc-45f2-912e-b7c547a76c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.305514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a33c0-b1cc-45f2-912e-b7c547a76c57 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.306413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a33c0-b1cc-45f2-912e-b7c547a76c57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:11.307991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a33c0-b1cc-45f2-912e-b7c547a76c57 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:11.316628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:11.339902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 361/727] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:09:11 2022] POST /identity/v3/services => generated 251 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:09:11.397584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13e4b-0853-4004-ac01-f011d471e3e9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:11.453650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:11.461443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:11.462894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.463402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.463942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.464878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:11.465411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:11.467146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:11.480885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 367/728] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:11.486230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a33c0-b1cc-45f2-912e-b7c547a76c57 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:11.646422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a33c0-b1cc-45f2-912e-b7c547a76c57 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:11.685998 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae246-2c6d-4933-99b9-c21f5ef57c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:11.686984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae246-2c6d-4933-99b9-c21f5ef57c6e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.687483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae246-2c6d-4933-99b9-c21f5ef57c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.687970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae246-2c6d-4933-99b9-c21f5ef57c6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.697061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ae246-2c6d-4933-99b9-c21f5ef57c6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:11.698961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ae246-2c6d-4933-99b9-c21f5ef57c6e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-c95ae246-2c6d-4933-99b9-c21f5ef57c6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:11.711913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:11.712887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:09:11.713943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:11.716554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 362/729] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:11.722210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:11.757295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21302980-6c00-43e7-9f5c-84af790b57d9 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.758173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21302980-6c00-43e7-9f5c-84af790b57d9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.758779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21302980-6c00-43e7-9f5c-84af790b57d9 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.760948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 363/730] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:11.774396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c6b3-98d6-4cf1-8ebc-e8a91260b310 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.775078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c6b3-98d6-4cf1-8ebc-e8a91260b310 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.775857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c6b3-98d6-4cf1-8ebc-e8a91260b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.807048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3bc9c6b3-98d6-4cf1-8ebc-e8a91260b310 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:11.808776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3bc9c6b3-98d6-4cf1-8ebc-e8a91260b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:11.845202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8690b-740b-4e7f-afb2-56b4df96ba70 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:11.885586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:11.886981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.888581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.889087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.890059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:11.890779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:11.893341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:11.905676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:11.931878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 364/731] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:09:11.932096 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 368/732] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Oct 6 12:09:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:11.937438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:11.945516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b38a4-bb63-49f9-90d1-dfddc00195d8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.946198 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b38a4-bb63-49f9-90d1-dfddc00195d8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.946694 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b38a4-bb63-49f9-90d1-dfddc00195d8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.948542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 365/733] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:11.954165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145665-5ec5-4fae-87ec-c91e85755664 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:11.954446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145665-5ec5-4fae-87ec-c91e85755664 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:11.954820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145665-5ec5-4fae-87ec-c91e85755664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:11.982168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-37145665-5ec5-4fae-87ec-c91e85755664 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:11.983292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-37145665-5ec5-4fae-87ec-c91e85755664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:12.044489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:12.105351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 366/734] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:09:12.137585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927bfe9-9341-411c-8019-cd6928306f2d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:12.173644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94a489-4613-4aa3-943d-a24037ed5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:12.174352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a489-4613-4aa3-943d-a24037ed5a8a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.174635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a489-4613-4aa3-943d-a24037ed5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.174907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94a489-4613-4aa3-943d-a24037ed5a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.247873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94a489-4613-4aa3-943d-a24037ed5a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:12.249395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94a489-4613-4aa3-943d-a24037ed5a8a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:12.250751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa39d-96d8-40c5-b30f-71d122df2678 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.251039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa39d-96d8-40c5-b30f-71d122df2678 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.251318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa39d-96d8-40c5-b30f-71d122df2678 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.252972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 367/735] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:12.258660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450325e5-dc63-4620-85e8-19f3b1c084b6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.258941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450325e5-dc63-4620-85e8-19f3b1c084b6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.259214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450325e5-dc63-4620-85e8-19f3b1c084b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.294233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-450325e5-dc63-4620-85e8-19f3b1c084b6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:12.297076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-450325e5-dc63-4620-85e8-19f3b1c084b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:12.304364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:12.360702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 369/736] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:11 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 06 12:09:12.362229 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94a489-4613-4aa3-943d-a24037ed5a8a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:12.384194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 368/737] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 06 12:09:12.385718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450325e5-dc63-4620-85e8-19f3b1c084b6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:12.445889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:12.472547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94a489-4613-4aa3-943d-a24037ed5a8a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:12.513687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71249f45-5b87-4770-a115-05b9b131478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:12.514247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249f45-5b87-4770-a115-05b9b131478d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.514525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249f45-5b87-4770-a115-05b9b131478d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.514797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249f45-5b87-4770-a115-05b9b131478d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.529086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71249f45-5b87-4770-a115-05b9b131478d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:12.532351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450325e5-dc63-4620-85e8-19f3b1c084b6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-71249f45-5b87-4770-a115-05b9b131478d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:12.534380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:12.535479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:12.536522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 370/738] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:12.538768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71249f45-5b87-4770-a115-05b9b131478d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:12.563109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:12.581523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:12.582727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.583164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.584050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.601868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:12.604278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:12.628007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:12.629324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:12.630360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:12.630360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:12.630360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:12.633037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 369/739] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:12.634327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:12.672209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71249f45-5b87-4770-a115-05b9b131478d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:12.711966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf375a-a9fe-474c-9dff-aeb4bb02a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:12.712752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf375a-a9fe-474c-9dff-aeb4bb02a31b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.713242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf375a-a9fe-474c-9dff-aeb4bb02a31b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.713486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf375a-a9fe-474c-9dff-aeb4bb02a31b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.727654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf375a-a9fe-474c-9dff-aeb4bb02a31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6ebf375a-a9fe-474c-9dff-aeb4bb02a31b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:12.732616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:12.733794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:12.734998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:12.737184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 371/740] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:09:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:12.737947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf375a-a9fe-474c-9dff-aeb4bb02a31b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:12.768755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:12.775641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf676-ca63-41a0-ab75-aacd96b656dc None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:12.812673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:12.813008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:12.813623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.813906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.814184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.815655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:12.816094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:12.817481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:12.826528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 370/741] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:12.832493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:12.845062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf375a-a9fe-474c-9dff-aeb4bb02a31b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:12.887621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:12.888625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.888912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.889187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.889990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:12.890301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:12.892215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:12.911264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 372/742] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:12.911264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:12.953149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fed0b-0321-4a93-bd5c-9de471216386 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:12.996893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:12.997584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:12.997866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:12.998214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:12.999918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:13.000428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.004783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.015399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 371/743] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:09:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:13.016214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.031365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783c69-f912-4fc1-b3e6-760a24fe59e3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.040054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:13.068995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:13.075671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75f93-c242-4309-ad4f-fcb2e8855baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.076280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75f93-c242-4309-ad4f-fcb2e8855baf None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.076559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75f93-c242-4309-ad4f-fcb2e8855baf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.076830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75f93-c242-4309-ad4f-fcb2e8855baf None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.077522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a75f93-c242-4309-ad4f-fcb2e8855baf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.079202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a75f93-c242-4309-ad4f-fcb2e8855baf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.097931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 373/744] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:09:12 2022] POST /identity/v3/services => generated 240 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:13.098612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75f93-c242-4309-ad4f-fcb2e8855baf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.149565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e1ca8-19ba-4546-ae21-dfab87c34b75 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.211264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.212507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.212860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.213451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.228491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.230925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.233307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75f93-c242-4309-ad4f-fcb2e8855baf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:13.249720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:13.250750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:13.251624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:13.251624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:13.251624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:13.251624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 372/745] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:13.252534 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.289814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.291955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.291955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.291955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.302415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.303877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:13.319231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:13.320196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:13.321074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:13.321074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:13.321074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:13.321074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:13.321074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:13.321074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:13.321074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:13.321074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:13.325100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 374/746] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:13.326150 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.357352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:13.395800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e92d-1259-4f57-95a4-789c61cccff5 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.404687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:13.433013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.433349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.433678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.433952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.445960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.447404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:13.462606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:13.463620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:13.464502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:13.464502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:13.464502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:13.468403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 373/747] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:13.469389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.475717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c36e9-0397-41b7-9248-e41e5a68963e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.521299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.522282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.522923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.523379 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.524729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:13.525611 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.527372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.549747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 375/748] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:13.549747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.592563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af672693-262e-4f34-913e-7b5daebedf93 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.622181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:13.638285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.639336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.639731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.640146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.640873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:13.641200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.643459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.666145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 374/749] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:13.667141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.694813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f49df-5b3a-497f-b7c4-15c93e1d3f05 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.708627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:13.752718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.754017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.754572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.755118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.756262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:13.756805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.759367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.777596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 376/750] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:13.778806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.819157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f3e0-7c08-4a46-a24d-0a403d097fb7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.862186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.862991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.863193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.863422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.871235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.872740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:13.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:13.886336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:09:13.887291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:13.893159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 375/751] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:13.894363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:13.921702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0dbd7-6923-492b-bd32-3d2c5d5b825f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:13.949058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:13.969131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:13.969848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:13.970852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:13.970852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:13.971417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=158a2959940b40378234c1ae5e566c97) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:13.971968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:13.974621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:13.993571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 377/752] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/role_assignments?user.id=158a2959940b40378234c1ae5e566c97&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:13.993571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:14.039813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:14.056444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a1e6e-5a7f-4170-beb1-63be4efd1395 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:14.113608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721c767-c371-4faf-ac42-4c17fb18ea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:14.114295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c767-c371-4faf-ac42-4c17fb18ea38 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:14.114642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c767-c371-4faf-ac42-4c17fb18ea38 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:14.114978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c767-c371-4faf-ac42-4c17fb18ea38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:14.131224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721c767-c371-4faf-ac42-4c17fb18ea38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:14.133578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721c767-c371-4faf-ac42-4c17fb18ea38 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:14.137682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a8591-13e2-4bfd-af2a-389e47078478 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4721c767-c371-4faf-ac42-4c17fb18ea38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:14.154213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:14.155269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:14.156225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:14.161372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 376/753] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:14.163614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416e503-a472-4ea6-b150-9afb57c25b18 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:14.163898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416e503-a472-4ea6-b150-9afb57c25b18 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:14.164238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416e503-a472-4ea6-b150-9afb57c25b18 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:14.166338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 377/754] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:14.167599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416e503-a472-4ea6-b150-9afb57c25b18 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:14.195369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c71ed8-6617-4cfa-a7c9-c51960a18f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:14.195669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71ed8-6617-4cfa-a7c9-c51960a18f70 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:14.195812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71ed8-6617-4cfa-a7c9-c51960a18f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:14.196136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71ed8-6617-4cfa-a7c9-c51960a18f70 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:14.196766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c71ed8-6617-4cfa-a7c9-c51960a18f70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:14.197077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c71ed8-6617-4cfa-a7c9-c51960a18f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:14.199269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c71ed8-6617-4cfa-a7c9-c51960a18f70 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:14.221353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 378/755] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:09:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:14.222764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754266db-daf7-4d12-9b82-e1b216b66368 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:14.223060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754266db-daf7-4d12-9b82-e1b216b66368 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:14.223336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754266db-daf7-4d12-9b82-e1b216b66368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:14.244023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-754266db-daf7-4d12-9b82-e1b216b66368 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:14.245226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-754266db-daf7-4d12-9b82-e1b216b66368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:14.303078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:14.307740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416e503-a472-4ea6-b150-9afb57c25b18 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:14.351269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:14.351509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 379/756] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:14.352501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:14.352734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754266db-daf7-4d12-9b82-e1b216b66368 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:14.353322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:14.353821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:14.354811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:14.355348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:14.358414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:14.383687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 378/757] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Oct 6 12:09:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:14.394652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:14.404287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:14.577874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754266db-daf7-4d12-9b82-e1b216b66368 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:14.610989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84687f-1106-40a7-9cd5-3aa28e38984f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:14.646226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:14.647082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:14.647500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:14.647949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:14.667585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:14.670521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:14.690922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:14.691945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:14.692828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:14.692828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:14.692828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:14.692828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 380/758] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:14.693557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:14.697440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d02a8-845b-498e-ae44-5ef60939e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:14.699415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d02a8-845b-498e-ae44-5ef60939e5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:14.699940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d02a8-845b-498e-ae44-5ef60939e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:14.700411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d02a8-845b-498e-ae44-5ef60939e5a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:14.737937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:14.792869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:14.795672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d02a8-845b-498e-ae44-5ef60939e5a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:14.797250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d02a8-845b-498e-ae44-5ef60939e5a3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:14.825729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f21e2-c051-429d-8f09-8f6f7b0a39cb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:14.867734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:14.869172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:14.869673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:14.870263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:14.871158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:14.872708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:14.885305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:14.886397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:14.887268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:14.889810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 381/759] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Oct 6 12:09:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:14.894851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:14.921485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 379/760] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:09:14.922492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d02a8-845b-498e-ae44-5ef60939e5a3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:14.995217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:15.011990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250b40d-c5a3-4a13-aeba-6d7cb6c2a754 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.044188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d02a8-845b-498e-ae44-5ef60939e5a3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.057498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.058486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.058970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.059470 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.060326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:15.060840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.062639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.071918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:15.079881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 382/761] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:15.081291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.083711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.084381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.085039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.085311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.085990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:15.086296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.087725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.097956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 380/762] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Oct 6 12:09:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:15.097956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.207912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168d55-763b-4d49-b89d-2b1b28001e42 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.213140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f762d9-639c-484f-8cf1-b9703a35838c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.238739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:15.249337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.250291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.250674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.251140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.253176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.254159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.254634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.255159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.263340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.265163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.266014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.268206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:15.278909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:15.279847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:15.280739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:15.280739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:15.280739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:15.280739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:15.280739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:15.280739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:15.280739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:15.280739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:15.283434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 381/763] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:15.284337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:15.285412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:15.286859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:15.286859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:15.286859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:15.286859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 383/764] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:15.287358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.289112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.351840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:15.402044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2921c-0376-4d92-8753-02a67392136b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.411824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2bc1-6d43-4ed2-91b2-567345b842a4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.440194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.460910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.460910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.460910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.460910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:15.460910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.460910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.461392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 382/765] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Oct 6 12:09:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:15.461392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.461530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.462123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.462832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.464269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.465235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:15.465797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.469370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.484772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 384/766] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:15.486991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.514115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:15.579993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5125f65-5c9c-44d7-9bdd-64491090df87 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.613755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf23030-5aed-4a25-b07f-38219d4466ce None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.616187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.616913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.617269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.618409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.618409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:15.618615 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.620088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.638105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:15.638313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 383/767] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:15.638981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.657665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.659037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.659323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.659597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.660667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] RBAC: Adding query filter params (interface=public, service_id=c37275bf7e444ca9a69ee9c824c15bc0, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:15.660985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.662411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.670569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 385/768] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Oct 6 12:09:15 2022] GET /identity/v3/endpoints?service_id=c37275bf7e444ca9a69ee9c824c15bc0&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:15.671408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.779545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7e91b-1ec3-4050-a5ac-60806e427282 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.788666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:15.814925 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8074-499d-4310-a69e-6ad60febb53c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:15.827214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9eec74-4c1e-478b-851a-2490a1676238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.827886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9eec74-4c1e-478b-851a-2490a1676238 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.828167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9eec74-4c1e-478b-851a-2490a1676238 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.828445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9eec74-4c1e-478b-851a-2490a1676238 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/1bd257708357455d99990b01af81e5b0/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.831404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9eec74-4c1e-478b-851a-2490a1676238 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=1bd257708357455d99990b01af81e5b0, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.832874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9eec74-4c1e-478b-851a-2490a1676238 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.848625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 384/769] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:09:15 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/1bd257708357455d99990b01af81e5b0/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:09:15.849756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98afe-27cd-4594-b88a-ada93ccda72f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.850082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98afe-27cd-4594-b88a-ada93ccda72f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.850377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98afe-27cd-4594-b88a-ada93ccda72f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.852051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 385/770] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:15.852488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98afe-27cd-4594-b88a-ada93ccda72f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:15.873299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4833047-d12e-443e-abb2-6a88a9e7fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:15.874088 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4833047-d12e-443e-abb2-6a88a9e7fea2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.874482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4833047-d12e-443e-abb2-6a88a9e7fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.874872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4833047-d12e-443e-abb2-6a88a9e7fea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.883919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4833047-d12e-443e-abb2-6a88a9e7fea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:15.885899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4833047-d12e-443e-abb2-6a88a9e7fea2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f4833047-d12e-443e-abb2-6a88a9e7fea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:15.898945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:15.900392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:15.901930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:15.901930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:15.901930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:15.901930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:15.901930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:15.901930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:15.901930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:15.901930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:15.905657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 386/771] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:15.907226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb961a-0022-4d2d-a631-853708af6546 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:15.907680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb961a-0022-4d2d-a631-853708af6546 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:15.907863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb961a-0022-4d2d-a631-853708af6546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:15.928544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-97fb961a-0022-4d2d-a631-853708af6546 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:15.929916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-97fb961a-0022-4d2d-a631-853708af6546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:15.963709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:16.024410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 387/772] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:16.026502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb961a-0022-4d2d-a631-853708af6546 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:16.059474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98afe-27cd-4594-b88a-ada93ccda72f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:16.118193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cff8fa-0f8b-43fb-9b6c-c35a5717e9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:16.119162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cff8fa-0f8b-43fb-9b6c-c35a5717e9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:16.119608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cff8fa-0f8b-43fb-9b6c-c35a5717e9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:16.120047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cff8fa-0f8b-43fb-9b6c-c35a5717e9d7 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:16.121087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cff8fa-0f8b-43fb-9b6c-c35a5717e9d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:16.123476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cff8fa-0f8b-43fb-9b6c-c35a5717e9d7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:16.132419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 386/773] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:09:15 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:16.182710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb961a-0022-4d2d-a631-853708af6546 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:16.229014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb33728-8552-4592-9e09-c67098fc7a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:16.230535 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33728-8552-4592-9e09-c67098fc7a65 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:16.231036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33728-8552-4592-9e09-c67098fc7a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:16.231548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33728-8552-4592-9e09-c67098fc7a65 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:16.232484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33728-8552-4592-9e09-c67098fc7a65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:16.233019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33728-8552-4592-9e09-c67098fc7a65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:16.234844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33728-8552-4592-9e09-c67098fc7a65 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:16.250511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 388/774] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:16.257236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cff8fa-0f8b-43fb-9b6c-c35a5717e9d7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:16.317271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:16.384516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7c59-269a-411b-b4d6-18abb209fe2d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:16.384854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7c59-269a-411b-b4d6-18abb209fe2d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:16.385068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7c59-269a-411b-b4d6-18abb209fe2d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:16.386748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 389/775] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:16.392166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd6c5e-1817-40a9-bbb1-457413071417 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:16.392522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd6c5e-1817-40a9-bbb1-457413071417 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:16.392990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd6c5e-1817-40a9-bbb1-457413071417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:16.415508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-11cd6c5e-1817-40a9-bbb1-457413071417 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:16.416841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-11cd6c5e-1817-40a9-bbb1-457413071417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:16.417349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cff8fa-0f8b-43fb-9b6c-c35a5717e9d7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:16.446681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:16.460773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:16.461481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:16.461792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:16.462066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:16.462796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=858b93ae249749b09d4a340668c3f970) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:16.463104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:16.464815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:16.477799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 387/776] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:16 2022] GET /identity/v3/role_assignments?user.id=858b93ae249749b09d4a340668c3f970&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:16.505512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 390/777] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:16.511020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:16.675023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:16.686658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b38093-9c56-4cae-99c7-5d415a014b16 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:16.750237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:16.750898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:16.751175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:16.751446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] PATH_INFO: `/v3/services/network` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:16.752130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:16.755338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:16.776351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:16.777498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:16.778421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 388/778] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:16 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:16.786681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd6c5e-1817-40a9-bbb1-457413071417 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:16.884170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:16.976241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd6c5e-1817-40a9-bbb1-457413071417 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:17.040539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:17.041166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:17.041447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:17.041751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:17.042402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:17.042708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:17.044092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:17.054622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 391/779] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:17.058964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:17.069798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160c1b4-aa86-432a-b482-9f7d3bef1584 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:17.106593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:17.150551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22eb2-eafe-4582-8624-9e8a61ca1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:17.151203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22eb2-eafe-4582-8624-9e8a61ca1c66 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:17.151480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22eb2-eafe-4582-8624-9e8a61ca1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:17.151751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22eb2-eafe-4582-8624-9e8a61ca1c66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:17.170613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a22eb2-eafe-4582-8624-9e8a61ca1c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-a3a22eb2-eafe-4582-8624-9e8a61ca1c66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:17.175725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:17.176704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:17.177596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:17.178278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 389/780] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:17.189897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22eb2-eafe-4582-8624-9e8a61ca1c66 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:17.238002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:17.284297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac5e83-ca40-47d5-b4ba-cadcceeed1f9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:17.353421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:17.354135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:17.354422 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:17.354705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:17.355354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:17.355661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:17.357036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:17.368176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 392/781] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:17.373150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22eb2-eafe-4582-8624-9e8a61ca1c66 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:17.374860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:17.443053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:17.443677 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:17.444004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:17.444281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:17.444956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:17.446740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:17.448135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:17.474086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 390/782] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:17.475061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:17.535029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:17.567837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deccd5-01ab-4220-885b-6930994bce8b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:17.629941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:17.632310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:17.632936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:17.633217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:17.633495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:17.634861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] RBAC: Adding query filter params (interface=public, service_id=35fca140c5be41069d8dfa9317c81363, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:17.635387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:17.636796 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:17.650358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 393/783] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Oct 6 12:09:17 2022] GET /identity/v3/endpoints?service_id=35fca140c5be41069d8dfa9317c81363&interface=public®ion_id=RegionOne => generated 194 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:17.655723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:17.671110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62dc1c-4d07-4369-bd81-71cf3c7fef74 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:17.734438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:17.735093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:17.735331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:17.735607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:17.757157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:17.759917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:17.792031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:17.793048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:17.793982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:17.793982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:17.793982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:17.793982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 391/784] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:17.806537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:17.853647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be70f5-fa44-4f1f-9d37-338bdf181d1a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:17.921418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc1a6c-7a2d-429a-8e00-1e74767f759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:17.923268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc1a6c-7a2d-429a-8e00-1e74767f759b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:17.924578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc1a6c-7a2d-429a-8e00-1e74767f759b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:17.925209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc1a6c-7a2d-429a-8e00-1e74767f759b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:17.926804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc1a6c-7a2d-429a-8e00-1e74767f759b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:17.928573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc1a6c-7a2d-429a-8e00-1e74767f759b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:17.947095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 394/785] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:09:17 2022] GET /identity/v3/services => generated 772 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:18.004210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d11f91-5b84-496e-a35e-571df19b5984 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:18.058948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:18.066736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:18.067750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:18.068277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:18.068764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:18.069671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:18.070204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:18.075502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:18.097151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 392/786] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:18.102728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc1a6c-7a2d-429a-8e00-1e74767f759b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:18.131309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:18.251191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc1a6c-7a2d-429a-8e00-1e74767f759b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:18.289335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:18.290017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:18.290270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:18.290545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:18.301166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:18.302766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:18.318161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:18.319169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:18.320741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 395/787] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:18.325310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:18.463791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb224161-593d-4a78-b376-35ba52df48b0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:18.504515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2097-8988-408c-8135-ec3391a007e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:18.505057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2097-8988-408c-8135-ec3391a007e5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:18.505387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2097-8988-408c-8135-ec3391a007e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:18.506119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2097-8988-408c-8135-ec3391a007e5 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:18.506877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2097-8988-408c-8135-ec3391a007e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:18.507184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2097-8988-408c-8135-ec3391a007e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:18.508698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2097-8988-408c-8135-ec3391a007e5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:18.529737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 393/788] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Oct 6 12:09:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:18.535567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:18.643591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:18.676341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4838ed-a7b0-4056-8f04-98b18f383470 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:18.676675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4838ed-a7b0-4056-8f04-98b18f383470 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:18.676885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4838ed-a7b0-4056-8f04-98b18f383470 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:18.678596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 394/789] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:18.684321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5cae-5910-487a-b3ea-606127c346a2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:18.684714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5cae-5910-487a-b3ea-606127c346a2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:18.684894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5cae-5910-487a-b3ea-606127c346a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:18.685337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a477e25-b31f-45d0-92b2-14c4246622bc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:18.728984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8b7d5cae-5910-487a-b3ea-606127c346a2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:18.730880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8b7d5cae-5910-487a-b3ea-606127c346a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:18.747373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:18.748034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:18.748319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:18.748595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:18.770931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:18.772404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:18.793688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:18.796007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:18.798095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:18.798095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:18.798095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:18.798095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 396/790] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:18.807088 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:18.830494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:18.853632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 395/791] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:18.873002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bd76-770f-4879-9846-f1c0de536a5f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:18.873667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bd76-770f-4879-9846-f1c0de536a5f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:18.874173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bd76-770f-4879-9846-f1c0de536a5f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:18.877755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 396/792] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:18.882324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0f32-f9cc-4c31-87f1-7bab6a4f3007 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:18.882877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0f32-f9cc-4c31-87f1-7bab6a4f3007 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:18.883358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0f32-f9cc-4c31-87f1-7bab6a4f3007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:18.902589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4e1b0f32-f9cc-4c31-87f1-7bab6a4f3007 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:18.904114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4e1b0f32-f9cc-4c31-87f1-7bab6a4f3007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:18.973737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c77ed-583c-45b7-9cce-7609418b3012 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:19.005926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:19.014582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:19.015864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.018395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.018684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.019376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:19.019687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:19.024491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:19.051968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 397/793] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:19.057737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:19.108269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 397/794] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:19.169866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32f3cf-4a65-4c77-8e53-66ad039a8495 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:19.175036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b0f32-f9cc-4c31-87f1-7bab6a4f3007 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:19.221361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:19.222598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.223134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.223628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.231603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:19.233566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:19.258193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:19.259164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:19.260085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:19.260085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:19.260085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:19.260085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:19.260085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:19.260085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:19.260085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:19.260085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:19.270282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 398/795] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:19.279161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:19.350072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:19.401813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3e0ca-6fad-46bb-bd74-ff146afe47c8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:19.450500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:19.451181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.451563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.451936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.452813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:19.453222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:19.454234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b0f32-f9cc-4c31-87f1-7bab6a4f3007 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:19.455663 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:19.469888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:19.476031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 399/796] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:19.482709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:19.516982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6bfd7-be10-445a-848d-e85874b6b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:19.518134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6bfd7-be10-445a-848d-e85874b6b95f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.518539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6bfd7-be10-445a-848d-e85874b6b95f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.519116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6bfd7-be10-445a-848d-e85874b6b95f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.531342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6bfd7-be10-445a-848d-e85874b6b95f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-5bf6bfd7-be10-445a-848d-e85874b6b95f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:19.537561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:19.538519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:19.539380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 398/797] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:19.540106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6bfd7-be10-445a-848d-e85874b6b95f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:19.615704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eec669-05c6-4ee7-9de8-462d65319dbe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:19.617981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:19.663246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6bfd7-be10-445a-848d-e85874b6b95f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:19.665542 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecee098-69b8-48b2-9258-0a5845a75fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:19.666204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecee098-69b8-48b2-9258-0a5845a75fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.666488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecee098-69b8-48b2-9258-0a5845a75fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.666765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecee098-69b8-48b2-9258-0a5845a75fe2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.667363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecee098-69b8-48b2-9258-0a5845a75fe2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:19.668741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecee098-69b8-48b2-9258-0a5845a75fe2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5ecee098-69b8-48b2-9258-0a5845a75fe2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:19.678646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:19.679732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:19.685668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 400/798] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Oct 6 12:09:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:19.686650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f443a4-9e2a-43b0-90a9-967b208f04cf None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.686650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f443a4-9e2a-43b0-90a9-967b208f04cf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.686650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f443a4-9e2a-43b0-90a9-967b208f04cf None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.686650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 401/799] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:19.686650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f443a4-9e2a-43b0-90a9-967b208f04cf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:19.725278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50081ef-a29a-4035-9f60-ffa09f1be0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:19.725909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50081ef-a29a-4035-9f60-ffa09f1be0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.726226 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50081ef-a29a-4035-9f60-ffa09f1be0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.726529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50081ef-a29a-4035-9f60-ffa09f1be0a7 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/158a2959940b40378234c1ae5e566c97/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.729192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50081ef-a29a-4035-9f60-ffa09f1be0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=158a2959940b40378234c1ae5e566c97, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:19.731085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50081ef-a29a-4035-9f60-ffa09f1be0a7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:19.747718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 399/800] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:09:19 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/158a2959940b40378234c1ae5e566c97/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:09:19.749227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50081ef-a29a-4035-9f60-ffa09f1be0a7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:19.811618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:19.829038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f443a4-9e2a-43b0-90a9-967b208f04cf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:19.881195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac55312-76d0-413e-805e-a434413d884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:19.881947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac55312-76d0-413e-805e-a434413d884f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.882303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac55312-76d0-413e-805e-a434413d884f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.882646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac55312-76d0-413e-805e-a434413d884f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.883398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac55312-76d0-413e-805e-a434413d884f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:19.883780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac55312-76d0-413e-805e-a434413d884f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:19.885886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac55312-76d0-413e-805e-a434413d884f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:19.899560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 402/801] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:19.901620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06b74-f1db-43f9-a461-66ec030a02bd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.901978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06b74-f1db-43f9-a461-66ec030a02bd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.902322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06b74-f1db-43f9-a461-66ec030a02bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.925883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d6c06b74-f1db-43f9-a461-66ec030a02bd None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:19.927571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d6c06b74-f1db-43f9-a461-66ec030a02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:19.935214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50081ef-a29a-4035-9f60-ffa09f1be0a7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:19.970842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:19.995166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:19.995702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:19.995980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:19.996252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:19.996887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:19.997191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:20.000164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:20.005772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 400/802] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Oct 6 12:09:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:20.006747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:20.047151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 403/803] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:20.048820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c06b74-f1db-43f9-a461-66ec030a02bd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:20.198663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:20.210128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdd58f-bc8f-4501-a762-3c79bd9a3148 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:20.233851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c06b74-f1db-43f9-a461-66ec030a02bd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:20.271882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:20.272418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:20.272698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:20.272968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:20.273654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:20.273963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:20.275602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:20.281403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 404/804] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Oct 6 12:09:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:20.289736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:20.322740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:20.362342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:20.363011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:20.363296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:20.363574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:20.398764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:20.400523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:20.401457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38dbf-456c-4fc7-bb75-f00ef3708979 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:20.427427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:20.428541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:20.429625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:20.429625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:20.429625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:20.429625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 401/805] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:20.429625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:20.443183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41328e17-5e64-473c-a1f7-b9531ae5d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:20.443863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328e17-5e64-473c-a1f7-b9531ae5d9a7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:20.444149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328e17-5e64-473c-a1f7-b9531ae5d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:20.444426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328e17-5e64-473c-a1f7-b9531ae5d9a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:20.445112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41328e17-5e64-473c-a1f7-b9531ae5d9a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:20.446533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41328e17-5e64-473c-a1f7-b9531ae5d9a7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:20.474908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 405/806] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:09:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:09:20.475817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41328e17-5e64-473c-a1f7-b9531ae5d9a7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:20.635807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b961c29-6a62-435f-939c-41676f471f08 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:20.727080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552228ed-3d4c-47d0-9e39-331f0b67472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:20.727760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552228ed-3d4c-47d0-9e39-331f0b67472d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:20.728040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552228ed-3d4c-47d0-9e39-331f0b67472d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:20.728309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552228ed-3d4c-47d0-9e39-331f0b67472d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:20.743335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552228ed-3d4c-47d0-9e39-331f0b67472d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-552228ed-3d4c-47d0-9e39-331f0b67472d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:20.751413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:20.753082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:20.753968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:20.754827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 402/807] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:09:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:20.757154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27b809-b0d0-4867-aacb-4ddc02a0afa9 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:20.757663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27b809-b0d0-4867-aacb-4ddc02a0afa9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:20.758138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27b809-b0d0-4867-aacb-4ddc02a0afa9 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:20.761117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 403/808] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:20.770127 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a695-0b37-45bc-8abd-27157efb2359 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:20.770484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a695-0b37-45bc-8abd-27157efb2359 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:20.770817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a695-0b37-45bc-8abd-27157efb2359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:20.778265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:20.780428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:20.797182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9ce3a695-0b37-45bc-8abd-27157efb2359 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:20.799113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9ce3a695-0b37-45bc-8abd-27157efb2359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:20.816953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41328e17-5e64-473c-a1f7-b9531ae5d9a7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:20.869452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:20.870127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:20.870414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:20.870692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:20.871402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:20.871705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:20.873190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:20.900330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 406/809] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:20.901661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:20.929633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 404/810] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:20.930964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a695-0b37-45bc-8abd-27157efb2359 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:21.141418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e1c0-47c7-46a4-ba5d-5d2ea1b9f192 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:21.160719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a695-0b37-45bc-8abd-27157efb2359 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:21.196105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:21.203675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:21.205287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:21.205834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:21.206373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:21.218728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:21.221599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:21.225972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:21.226955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:21.227476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:21.227969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:21.228877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:21.229397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:21.231163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:21.248424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:21.258545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:21.259699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:09:21.260758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:21.264526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 407/811] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:09:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:21.269517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 405/812] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:09:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:21.277174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:21.286303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:21.506051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2bb62-6a78-4412-8775-244ca2213712 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:21.553976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d21673-9c29-42a7-aa05-25bd6e07a761 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:21.558968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253778f-ca47-4903-a308-79007576d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:21.559881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253778f-ca47-4903-a308-79007576d06e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:21.560382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253778f-ca47-4903-a308-79007576d06e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:21.560856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253778f-ca47-4903-a308-79007576d06e None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:21.561886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253778f-ca47-4903-a308-79007576d06e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:21.567771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253778f-ca47-4903-a308-79007576d06e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:21.569524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253778f-ca47-4903-a308-79007576d06e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:21.600731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 406/813] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:09:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:21.605314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253778f-ca47-4903-a308-79007576d06e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:21.644342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:21.645507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:21.646639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:21.647159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:21.666564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:21.668636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:21.690412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:21.691662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:21.692803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:21.692803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:21.692803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:21.695652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 408/814] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:21.697063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:21.704226 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:21.772410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253778f-ca47-4903-a308-79007576d06e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:21.775689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:21.824905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:21.826175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:21.826554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:21.826933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] PATH_INFO: `/v3/services/network` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:21.827621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:21.829113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:21.843755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:21.845769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:21.847618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 407/815] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:21 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:21.848444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:21.850277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a914f-8b76-4115-9b27-5f7747888223 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:21.898017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3df40-c553-4fe8-8fea-d21bc77af94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:21.898993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3df40-c553-4fe8-8fea-d21bc77af94e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:21.899488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3df40-c553-4fe8-8fea-d21bc77af94e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:21.900299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3df40-c553-4fe8-8fea-d21bc77af94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:21.977667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b78d-7311-4910-bbdf-2a1663905676 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:21.996088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:21.997664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3df40-c553-4fe8-8fea-d21bc77af94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:21.999317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3df40-c553-4fe8-8fea-d21bc77af94e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.023070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:22.024198 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.024578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.025220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.026106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:22.026515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:22.028624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.047070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 408/816] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:22.048962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:22.067693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:22.137504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 409/817] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:09:22.138581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3df40-c553-4fe8-8fea-d21bc77af94e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:22.197185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58fc4-5ded-4f16-a3b7-5e6c57bf80ae None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:22.241223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:22.242181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.242608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.243027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.243858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:22.244323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:22.246099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.252101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 409/818] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:22.253360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:22.277624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3df40-c553-4fe8-8fea-d21bc77af94e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:22.317635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:22.325026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:22.326316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.326938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.327427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.338194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:22.340176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:22.356350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:22.357370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:22.358343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:22.361105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 410/819] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:09:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:22.362431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:22.380006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:22.403086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46686dbc-3929-4e0c-9899-38d252e2e5c3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:22.456436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:22.457343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.457859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.458322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.471756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:22.473272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.474643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97001fb-d1c7-4ae0-b70b-1f1890373f39 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:22.489397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:22.490460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:22.491349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:22.491349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:22.491349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:22.491349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 410/820] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:22.492057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:22.536716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00917c-1058-4985-bb48-2231acbb5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:22.537264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00917c-1058-4985-bb48-2231acbb5b69 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.537582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00917c-1058-4985-bb48-2231acbb5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.537865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00917c-1058-4985-bb48-2231acbb5b69 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.538521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00917c-1058-4985-bb48-2231acbb5b69 None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:22.538832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00917c-1058-4985-bb48-2231acbb5b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:22.540221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00917c-1058-4985-bb48-2231acbb5b69 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.553435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 411/821] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:22.553435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1b9d4-1e52-45f6-8a1e-d0107467ac8b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.553435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1b9d4-1e52-45f6-8a1e-d0107467ac8b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.553435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1b9d4-1e52-45f6-8a1e-d0107467ac8b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.553435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 412/822] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:22.553435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1b9d4-1e52-45f6-8a1e-d0107467ac8b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:22.629699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:22.643012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d63051-9b0f-4c74-9af2-0fa980824c2d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:22.666204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:22.685309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0ad67-0dd4-4967-9f7c-e5160585273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:22.685962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ad67-0dd4-4967-9f7c-e5160585273d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.686446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ad67-0dd4-4967-9f7c-e5160585273d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.686851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ad67-0dd4-4967-9f7c-e5160585273d None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.687632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0ad67-0dd4-4967-9f7c-e5160585273d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:22.687945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0ad67-0dd4-4967-9f7c-e5160585273d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:22.689660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0ad67-0dd4-4967-9f7c-e5160585273d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.699479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1b9d4-1e52-45f6-8a1e-d0107467ac8b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:22.715303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 411/823] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Oct 6 12:09:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:22.715303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052cac-997e-4b45-a37f-125c1bff527b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.715303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052cac-997e-4b45-a37f-125c1bff527b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.715303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052cac-997e-4b45-a37f-125c1bff527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.730771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b6052cac-997e-4b45-a37f-125c1bff527b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:22.732091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b6052cac-997e-4b45-a37f-125c1bff527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:22.752554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:22.753176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.754304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.754617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.755539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:22.756489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:22.758231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.779785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 413/824] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:22.783149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:22.824906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 412/825] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:22.825610 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6052cac-997e-4b45-a37f-125c1bff527b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:22.927141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af332cd3-02fa-4911-8935-0fd572012942 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:22.944925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:22.971085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc90b8c-34ef-4c6f-820c-784d2e5b6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:22.972288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc90b8c-34ef-4c6f-820c-784d2e5b6489 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:22.972747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc90b8c-34ef-4c6f-820c-784d2e5b6489 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:22.973183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc90b8c-34ef-4c6f-820c-784d2e5b6489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:22.973898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6052cac-997e-4b45-a37f-125c1bff527b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:22.974232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc90b8c-34ef-4c6f-820c-784d2e5b6489 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:22.976050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc90b8c-34ef-4c6f-820c-784d2e5b6489 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:22.983520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:23.013602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 414/826] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:09:22 2022] POST /identity/v3/endpoints => generated 337 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:23.013602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc90b8c-34ef-4c6f-820c-784d2e5b6489 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.036821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0064b5-d8e0-4aa0-961b-f5978bddf54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.038750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0064b5-d8e0-4aa0-961b-f5978bddf54f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.039572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0064b5-d8e0-4aa0-961b-f5978bddf54f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.040070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0064b5-d8e0-4aa0-961b-f5978bddf54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.056554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0064b5-d8e0-4aa0-961b-f5978bddf54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.058450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0064b5-d8e0-4aa0-961b-f5978bddf54f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-cd0064b5-d8e0-4aa0-961b-f5978bddf54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:23.076703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:23.077917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:23.078830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:23.078830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:23.078830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:23.081166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 413/827] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:23.082935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88769ab-f1b0-4303-963a-1c42deaa4795 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.083414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88769ab-f1b0-4303-963a-1c42deaa4795 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.083861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88769ab-f1b0-4303-963a-1c42deaa4795 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.090040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 414/828] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:23.091798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f33fc-d7d8-42e8-8080-6f1dbd3fb410 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.092271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f33fc-d7d8-42e8-8080-6f1dbd3fb410 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.092838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f33fc-d7d8-42e8-8080-6f1dbd3fb410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.116496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-679f33fc-d7d8-42e8-8080-6f1dbd3fb410 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:23.118326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-679f33fc-d7d8-42e8-8080-6f1dbd3fb410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:23.164856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc90b8c-34ef-4c6f-820c-784d2e5b6489 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.202943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 415/829] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:23.203637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f33fc-d7d8-42e8-8080-6f1dbd3fb410 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.213966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.214861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.215285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.215728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.224156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.225944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:23.240723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:23.241908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 415/830] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:23.246204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.289696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:23.309590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:23.347149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f33fc-d7d8-42e8-8080-6f1dbd3fb410 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.378224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8626ee3-1fd5-47b6-93a0-e506acf3c102 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.384282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.384891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.385170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.385443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.386143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:23.386433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.387815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.400108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 416/831] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:23.400920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.419745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be83b-3d68-4cf1-aba9-1a00fc85e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.420381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be83b-3d68-4cf1-aba9-1a00fc85e97a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.420760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be83b-3d68-4cf1-aba9-1a00fc85e97a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.421067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be83b-3d68-4cf1-aba9-1a00fc85e97a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.434215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be83b-3d68-4cf1-aba9-1a00fc85e97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-547be83b-3d68-4cf1-aba9-1a00fc85e97a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:23.439764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:23.440993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:23.442061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:23.444141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 416/832] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:23.444920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be83b-3d68-4cf1-aba9-1a00fc85e97a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.517927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc10a8-e5f0-4d0c-924e-024021f394b0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.535957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:23.554213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be83b-3d68-4cf1-aba9-1a00fc85e97a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.555619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.556223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.556493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.556771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.557455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:23.557788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.559237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.567750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:23.589709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.590364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.590645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.590924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.599199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.600577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:23.613411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:23.614504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 417/833] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:23.615414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.691760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 417/834] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:23.692507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.723246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77062d-6926-4e4a-a269-1220f54aebae None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.756144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.756742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.757024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.757300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.758001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:23.758300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.759651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.768483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 418/835] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:23.769664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.793831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ccd8-696e-4b48-bdfa-4637a8100bef None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.803629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:23.827504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.828123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.828404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.828671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.829853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.831251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:23.839686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:23.840681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:23.841527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 418/836] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:23.842344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.871053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73db1a-43c9-466d-a226-65d6d8e04f27 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.884787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:23.904575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.905117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.905404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.905722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.906412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:23.906721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.908764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.920660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 419/837] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:23.921377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:23.946476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e29d9-5172-4269-8fd5-52211233c6b6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:23.979721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:23.980316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:23.980593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:23.980862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:23.981597 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=1bd257708357455d99990b01af81e5b0) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:23.981903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:23.983393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:23.997879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 419/838] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/role_assignments?user.id=1bd257708357455d99990b01af81e5b0&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:23.997879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:24.014491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:24.024393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c6d0-7534-4fb6-af92-16e7d9c38846 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:24.065744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:24.066901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:24.067367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:24.067626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:24.078870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:24.080446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:24.098347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:24.104310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:24.105284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:24.105284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:24.105284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:24.105284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 420/839] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:24.105284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:24.140420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa04d-26f6-4ede-a9c7-6d759e49b2c7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:24.143708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:24.187617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:24.188233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:24.188512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:24.188839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:24.189474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:24.189816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:24.191954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:24.196250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 420/840] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:24.197045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:24.229055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb8c9-735b-4fef-9f59-3467db7eeb7f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:24.267869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890d569-d1f9-46ae-b099-2ae9809ce048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:24.268534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d569-d1f9-46ae-b099-2ae9809ce048 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:24.268811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d569-d1f9-46ae-b099-2ae9809ce048 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:24.269080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d569-d1f9-46ae-b099-2ae9809ce048 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/858b93ae249749b09d4a340668c3f970/roles/473c27c2658941c492c7a8b45c37dddc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:24.288027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890d569-d1f9-46ae-b099-2ae9809ce048 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=858b93ae249749b09d4a340668c3f970, role_id=473c27c2658941c492c7a8b45c37dddc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:24.289954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890d569-d1f9-46ae-b099-2ae9809ce048 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:24.293940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:24.306526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 421/841] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:09:24 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/858b93ae249749b09d4a340668c3f970/roles/473c27c2658941c492c7a8b45c37dddc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:09:24.307733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890d569-d1f9-46ae-b099-2ae9809ce048 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:24.307868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f3d97-bbbc-4c89-99ef-12f736155529 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:24.363931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:24.365113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:24.365398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:24.365700 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:24.366382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:24.367050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:24.369099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:24.387573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 421/842] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:24.394092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:24.440746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:24.474400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890d569-d1f9-46ae-b099-2ae9809ce048 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:24.520959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:24.521604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:24.521889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:24.522163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:24.522809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:24.523115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:24.524488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:24.529482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 422/843] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:24.531235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c79709-4a21-43ba-bc11-11f2ef448abb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:24.583540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:24.584199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:24.584478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:24.584749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] PATH_INFO: `/v3/users/swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:24.596234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:24.598411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:24.616616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:24.617867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:24.618829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 422/844] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:24.623837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:24.694062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:24.740097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e19a5-628b-4ffd-b077-1c706eb4fc8e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:24.781883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:24.784781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:24.785275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:24.785777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:24.790769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:24.791326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:24.794041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:24.840266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 423/845] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Oct 6 12:09:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:24.847410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:24.948450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:24.963410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321170d-efdf-4636-9c02-3256d2da90db None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:24.999485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c0f1e-d191-47c0-b343-c6c2fe1aeb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:25.000464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c0f1e-d191-47c0-b343-c6c2fe1aeb07 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:25.000975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c0f1e-d191-47c0-b343-c6c2fe1aeb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:25.002064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c0f1e-d191-47c0-b343-c6c2fe1aeb07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:25.076314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c0f1e-d191-47c0-b343-c6c2fe1aeb07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:25.078163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c0f1e-d191-47c0-b343-c6c2fe1aeb07 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:25.178124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:25.187611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 423/846] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:09:25.197126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:25.311425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db191aa-657b-4384-8af0-f0ccab5208ae None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:25.338105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:25.355191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:25.355877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:25.356178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:25.356463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:25.368250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:25.369731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:25.387010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:25.388028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:25.388949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:25.388949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:25.388949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:25.388949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 424/847] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:25.398660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c0f1e-d191-47c0-b343-c6c2fe1aeb07 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:25.505461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c0f1e-d191-47c0-b343-c6c2fe1aeb07 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:25.544475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:25.545107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:25.545384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:25.545689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:25.546549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:25.546858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:25.548394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:25.561654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 424/848] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:25.570602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:25.688567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290d3db-c5a5-4ab4-90b6-e6efe7909cd2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:25.727092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:25.728037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:25.728504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:25.728982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:25.737841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:25.739532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:25.752523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:25.753509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:25.754453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:25.754453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:25.754453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:25.754453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:25.754453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:25.754453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:25.754453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:25.754453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:25.756704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 425/849] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:25.763414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:25.835633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:25.894413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd44fc3-08c3-438d-b312-39870d5e55c2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:25.931581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d2ad8-f73c-41f9-a8e4-4cae6d561002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:25.932199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d2ad8-f73c-41f9-a8e4-4cae6d561002 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:25.932476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d2ad8-f73c-41f9-a8e4-4cae6d561002 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:25.932745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d2ad8-f73c-41f9-a8e4-4cae6d561002 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:25.933434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d2ad8-f73c-41f9-a8e4-4cae6d561002 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:25.933767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d2ad8-f73c-41f9-a8e4-4cae6d561002 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:25.935271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d2ad8-f73c-41f9-a8e4-4cae6d561002 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:25.949563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 425/850] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:25.956647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:25.990946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:26.069406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d276-76e6-424f-93b1-e80aec4c560b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:26.106489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d86c1-3d4c-4467-8ac2-56a97f4f5902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:26.107426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d86c1-3d4c-4467-8ac2-56a97f4f5902 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:26.107927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d86c1-3d4c-4467-8ac2-56a97f4f5902 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:26.108413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d86c1-3d4c-4467-8ac2-56a97f4f5902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:26.109368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d86c1-3d4c-4467-8ac2-56a97f4f5902 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=158a2959940b40378234c1ae5e566c97) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:26.109907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d86c1-3d4c-4467-8ac2-56a97f4f5902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:26.112413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d86c1-3d4c-4467-8ac2-56a97f4f5902 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:26.119353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 426/851] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:25 2022] GET /identity/v3/role_assignments?user.id=158a2959940b40378234c1ae5e566c97&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:26.421008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34b00-3c0f-4125-8f01-fcb47268c4be None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:26.421555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34b00-3c0f-4125-8f01-fcb47268c4be None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:26.421555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34b00-3c0f-4125-8f01-fcb47268c4be None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:26.423846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 426/852] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:26.429074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b4c8-84ea-4f5a-98d4-e69f9caf1309 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:26.429576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b4c8-84ea-4f5a-98d4-e69f9caf1309 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:26.430110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b4c8-84ea-4f5a-98d4-e69f9caf1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:26.450177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a8b0b4c8-84ea-4f5a-98d4-e69f9caf1309 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:26.451757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a8b0b4c8-84ea-4f5a-98d4-e69f9caf1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:26.529164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 427/853] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:26.797440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b34b00-3c0f-4125-8f01-fcb47268c4be None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:26.813157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4c83a-c4e7-4c46-b9bd-0458e08b6bde None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:26.813868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4c83a-c4e7-4c46-b9bd-0458e08b6bde None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:26.813868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4c83a-c4e7-4c46-b9bd-0458e08b6bde None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:26.816260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 428/854] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:26.823674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8135cc-3119-4fd1-9817-d8a027de15ce None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:26.823980 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8135cc-3119-4fd1-9817-d8a027de15ce None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:26.824241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8135cc-3119-4fd1-9817-d8a027de15ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:26.844107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-de8135cc-3119-4fd1-9817-d8a027de15ce None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:26.846436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de8135cc-3119-4fd1-9817-d8a027de15ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:26.869908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:26.933736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 429/855] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:26.940120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f15a4-e320-4de0-ab9b-90997a7dfcc2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:26.940544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f15a4-e320-4de0-ab9b-90997a7dfcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:26.940949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f15a4-e320-4de0-ab9b-90997a7dfcc2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:26.943025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 430/856] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:26.949655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a691b-808a-482f-94cf-63b00e45edb5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:26.949939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a691b-808a-482f-94cf-63b00e45edb5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:26.950214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a691b-808a-482f-94cf-63b00e45edb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:26.956081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b34b00-3c0f-4125-8f01-fcb47268c4be None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:26.966217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:26.973172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dc7a691b-808a-482f-94cf-63b00e45edb5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:26.974194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dc7a691b-808a-482f-94cf-63b00e45edb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:26.996328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:26.997397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:26.997909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:26.998405 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:26.999245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:27.001403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:27.011767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:27.012762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:27.013687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:27.019189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 427/857] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Oct 6 12:09:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:27.022629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:27.061954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 431/858] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:27.135647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b91a9-e097-46dd-b1c6-a5fddea663d3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:27.171480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:27.172084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:27.172424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:27.172791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:27.173813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:27.174121 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:27.175503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:27.185223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 428/859] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:27.186725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a691b-808a-482f-94cf-63b00e45edb5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:27.254257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:27.283478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:27.302337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:27.305647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a691b-808a-482f-94cf-63b00e45edb5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:27.348126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:27.349081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:27.349619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:27.350097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:27.350949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:27.351448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:27.353553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:27.359882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 432/860] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:27.361132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:27.384264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8e9d2-098b-42a4-9d7f-6dba824db9d9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:27.424710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993795-3ed4-4397-949b-8e38c315ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:27.425559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993795-3ed4-4397-949b-8e38c315ce57 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:27.425945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993795-3ed4-4397-949b-8e38c315ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:27.426229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993795-3ed4-4397-949b-8e38c315ce57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:27.441043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e993795-3ed4-4397-949b-8e38c315ce57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4e993795-3ed4-4397-949b-8e38c315ce57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:27.447236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:27.448284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:27.449137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 429/861] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:09:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:27.455725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993795-3ed4-4397-949b-8e38c315ce57 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:27.505236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5210da-a695-42e3-8337-a20523e6a149 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:27.549694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877788d-07b2-4d27-bc4a-8d7bee0cd289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:27.550345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877788d-07b2-4d27-bc4a-8d7bee0cd289 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:27.550627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877788d-07b2-4d27-bc4a-8d7bee0cd289 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:27.550902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877788d-07b2-4d27-bc4a-8d7bee0cd289 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:27.551563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877788d-07b2-4d27-bc4a-8d7bee0cd289 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:27.552937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877788d-07b2-4d27-bc4a-8d7bee0cd289 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:27.569189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 433/862] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:09:27 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:27.579042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:27.582685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993795-3ed4-4397-949b-8e38c315ce57 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:27.635219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:27.635845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:27.636123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:27.636396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:27.637078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:27.637380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:27.638895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:27.649338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 430/863] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:09:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:27.655221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877788d-07b2-4d27-bc4a-8d7bee0cd289 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:27.668833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:27.776569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877788d-07b2-4d27-bc4a-8d7bee0cd289 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:27.814716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:27.816133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:27.816613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:27.817105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:27.828694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:27.831110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:27.846833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:27.848127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:27.849199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:27.849199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:27.849199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:27.850947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 434/864] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:27.856266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:27.969515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4b986-26aa-4721-9e87-b1b62b386491 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:28.006269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:28.006878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:28.007159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:28.007430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:28.008075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:28.008373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:28.009768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:28.022983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 431/865] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:28.028456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:28.091534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:28.140172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86440bac-017a-4322-a159-77757ad810f7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:28.180980 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:28.182015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:28.182498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:28.182971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:28.192670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:28.194556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:28.207480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:28.208451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:28.209386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:28.211907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 435/866] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:09:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:28.221744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:28.238704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:28.341169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042549-7f51-44be-ab61-3bbb5b42c27c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:28.382267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce28e1c-a6d2-4533-84d8-44e9ed1b8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:28.382878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28e1c-a6d2-4533-84d8-44e9ed1b8101 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:28.383155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28e1c-a6d2-4533-84d8-44e9ed1b8101 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:28.383463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28e1c-a6d2-4533-84d8-44e9ed1b8101 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:28.384158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce28e1c-a6d2-4533-84d8-44e9ed1b8101 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:28.384461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce28e1c-a6d2-4533-84d8-44e9ed1b8101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:28.385914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce28e1c-a6d2-4533-84d8-44e9ed1b8101 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:28.405146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 432/867] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Oct 6 12:09:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:28.413262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:28.448267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddfe1d-bf6b-438e-868f-6507df3b172c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:28.448782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddfe1d-bf6b-438e-868f-6507df3b172c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:28.449204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddfe1d-bf6b-438e-868f-6507df3b172c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:28.451285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 433/868] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:28.457895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306b05-8325-4050-9db9-03d87fcf2741 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:28.458168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306b05-8325-4050-9db9-03d87fcf2741 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:28.458443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306b05-8325-4050-9db9-03d87fcf2741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:28.484003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0d306b05-8325-4050-9db9-03d87fcf2741 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:28.485732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0d306b05-8325-4050-9db9-03d87fcf2741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:28.534393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c954b9-d058-4dfd-932b-34c22bd54d08 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:28.556741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:28.573729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24368-c4db-4720-bbb3-8ecc93885f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:28.574663 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24368-c4db-4720-bbb3-8ecc93885f2d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:28.575149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24368-c4db-4720-bbb3-8ecc93885f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:28.575664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24368-c4db-4720-bbb3-8ecc93885f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:28.585580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 434/869] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:28 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:28.660025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f24368-c4db-4720-bbb3-8ecc93885f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:28.661887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f24368-c4db-4720-bbb3-8ecc93885f2d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:28.768294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 436/870] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:28 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:09:28.774955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d306b05-8325-4050-9db9-03d87fcf2741 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:28.777981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:28.875606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24368-c4db-4720-bbb3-8ecc93885f2d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:28.911293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:28.947002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d306b05-8325-4050-9db9-03d87fcf2741 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:29.000394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:29.001570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.002158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.002629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.017931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24368-c4db-4720-bbb3-8ecc93885f2d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:29.033057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:29.034482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:29.067310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:29.068947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:29.071383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:29.071383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:29.071383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:29.071711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 435/871] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:29.078236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:29.082352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:29.083557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.085096 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.085714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.086470 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:29.088030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:29.102069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:29.103882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:29.105451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:29.109187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 437/872] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:29.112813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:29.189763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:29.225971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:29.246150 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61afb5-004c-4c6f-9ac7-3ee4d8925a8a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:29.268686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06080d6-68bc-4963-ae94-bb020b3722a2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:29.290150 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:29.291108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.291595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.292289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.293240 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:29.294192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:29.296046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:29.302313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 438/873] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:29.310797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:29.323617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:29.324662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.324662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.324873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.325437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:29.325792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:29.327187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:29.341316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 436/874] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:29.348070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:29.432545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bda34-cfb8-4b55-a587-66df224bbcc2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:29.463529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10042bfa-8895-422d-93f6-e6bc3ca5fc7d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:29.472128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:29.472754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.473034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.473311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.474005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:29.474312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:29.475782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:29.489938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 439/875] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:29.495893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:29.526694 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062890c-7a6e-40c2-8645-232142437fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:29.527761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062890c-7a6e-40c2-8645-232142437fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.528251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062890c-7a6e-40c2-8645-232142437fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.528719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062890c-7a6e-40c2-8645-232142437fb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.537164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062890c-7a6e-40c2-8645-232142437fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:29.539117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062890c-7a6e-40c2-8645-232142437fb8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3062890c-7a6e-40c2-8645-232142437fb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:29.553484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:29.554451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:29.555419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:29.555419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:29.555419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:29.555419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:29.555419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:29.555419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:29.555419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:29.555419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:29.557973 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 437/876] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:29.564394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:29.583567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:29.713943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd05c4-18d1-415e-80ca-cc6f27184a40 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:29.759351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:29.760356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.760844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.761313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.762250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:29.762766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:29.764443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:29.766901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538534-527c-4d8d-aff7-ac6da0c1731a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.767502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538534-527c-4d8d-aff7-ac6da0c1731a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.767974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538534-527c-4d8d-aff7-ac6da0c1731a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.770739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 438/877] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:29.777557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2777ff-8114-4992-a4f6-81764f171249 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.778643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2777ff-8114-4992-a4f6-81764f171249 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.779418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2777ff-8114-4992-a4f6-81764f171249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.785582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 440/878] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:29.788567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:29.808338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0c2777ff-8114-4992-a4f6-81764f171249 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:29.810562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0c2777ff-8114-4992-a4f6-81764f171249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:29.904041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:29.923885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 439/879] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:29.948880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de04dd-ea50-4207-9a14-ccd9ba519d90 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:29.989234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366522-135b-493f-9b03-24c2c1012bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:29.990531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366522-135b-493f-9b03-24c2c1012bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:29.991170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366522-135b-493f-9b03-24c2c1012bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:29.991745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366522-135b-493f-9b03-24c2c1012bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:29.993077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366522-135b-493f-9b03-24c2c1012bc7 None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=858b93ae249749b09d4a340668c3f970) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:29.993778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366522-135b-493f-9b03-24c2c1012bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:29.996242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366522-135b-493f-9b03-24c2c1012bc7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:30.008006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 441/880] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:29 2022] GET /identity/v3/role_assignments?user.id=858b93ae249749b09d4a340668c3f970&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:30.029961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe25d0-4e4a-4eab-8d83-91b3cdb49e6b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:30.030526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe25d0-4e4a-4eab-8d83-91b3cdb49e6b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:30.030953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe25d0-4e4a-4eab-8d83-91b3cdb49e6b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:30.033395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 440/881] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:30.039397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707537-5bc3-4041-ba3c-24c13eecaef7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:30.039917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707537-5bc3-4041-ba3c-24c13eecaef7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:30.040339 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707537-5bc3-4041-ba3c-24c13eecaef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:30.064192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fa707537-5bc3-4041-ba3c-24c13eecaef7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:30.065815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa707537-5bc3-4041-ba3c-24c13eecaef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:30.161408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 442/882] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:30.235039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe25d0-4e4a-4eab-8d83-91b3cdb49e6b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:30.380432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe25d0-4e4a-4eab-8d83-91b3cdb49e6b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:30.384366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:30.434364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03236-e619-44d8-925e-c9c09e1033e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:30.434982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03236-e619-44d8-925e-c9c09e1033e3 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:30.435377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03236-e619-44d8-925e-c9c09e1033e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:30.435598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03236-e619-44d8-925e-c9c09e1033e3 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:30.436281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff03236-e619-44d8-925e-c9c09e1033e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:30.436536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa707537-5bc3-4041-ba3c-24c13eecaef7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:30.437805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff03236-e619-44d8-925e-c9c09e1033e3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:30.460211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 441/883] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:09:30 2022] POST /identity/v3/services => generated 269 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:09:30.528760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:30.574485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa707537-5bc3-4041-ba3c-24c13eecaef7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:30.623938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:30.624612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:30.624892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:30.625171 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:30.626375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:30.628065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:30.638348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:30.639412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:30.640271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 443/884] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:30.646044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03236-e619-44d8-925e-c9c09e1033e3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:30.781311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03236-e619-44d8-925e-c9c09e1033e3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:30.829690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:30.834711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:30.835329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:30.835806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:30.836673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:30.837183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:30.838870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:30.845672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 442/885] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:30.850826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:30.960356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf8a6-eed6-46d2-8fab-d6af0c4255ce None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:30.987501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:30.996700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:30.997325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:30.997629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:30.997904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:30.998549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:30.998844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:31.000232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:31.006348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 444/886] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:31.014603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:31.050716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:31.140132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b3f5d-2194-4c7d-b831-aee11c1be6b1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:31.185760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d336c90-2ae6-468d-9d7d-68d1a7792280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:31.186375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d336c90-2ae6-468d-9d7d-68d1a7792280 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:31.186655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d336c90-2ae6-468d-9d7d-68d1a7792280 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:31.186924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d336c90-2ae6-468d-9d7d-68d1a7792280 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:31.187632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d336c90-2ae6-468d-9d7d-68d1a7792280 None admin] RBAC: Adding query filter params (interface=public, service_id=e9dc683e8e674a0f9452a1b036097a2c, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:31.187939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d336c90-2ae6-468d-9d7d-68d1a7792280 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:31.190184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d336c90-2ae6-468d-9d7d-68d1a7792280 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:31.198306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 443/887] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Oct 6 12:09:31 2022] GET /identity/v3/endpoints?service_id=e9dc683e8e674a0f9452a1b036097a2c&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:31.203992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:31.316225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5008e-1c12-48ff-a951-ba798189cd93 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:31.353464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45024c5-83f8-4040-93da-30f39f80dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:31.354495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45024c5-83f8-4040-93da-30f39f80dcaa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:31.355007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45024c5-83f8-4040-93da-30f39f80dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:31.355504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45024c5-83f8-4040-93da-30f39f80dcaa None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:31.356334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45024c5-83f8-4040-93da-30f39f80dcaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:31.357962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45024c5-83f8-4040-93da-30f39f80dcaa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:31.364687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 445/888] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:09:31 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:09:31.850190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d6ad5-72e3-4711-8cf8-a3befc66f55f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:31.850714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d6ad5-72e3-4711-8cf8-a3befc66f55f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:31.850714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d6ad5-72e3-4711-8cf8-a3befc66f55f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:31.852326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 444/889] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:31.857878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d12631-c82f-4b7d-941d-0e71fcdbd241 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:31.858170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d12631-c82f-4b7d-941d-0e71fcdbd241 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:31.858451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d12631-c82f-4b7d-941d-0e71fcdbd241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:31.876594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d6d12631-c82f-4b7d-941d-0e71fcdbd241 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:31.877829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d6d12631-c82f-4b7d-941d-0e71fcdbd241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:31.935119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:31.954764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 446/890] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:32.228602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d6ad5-72e3-4711-8cf8-a3befc66f55f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:32.339323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:32.353016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d6ad5-72e3-4711-8cf8-a3befc66f55f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:32.400418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec994d0-d92a-40e9-91f8-6a67ac91a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:32.401271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec994d0-d92a-40e9-91f8-6a67ac91a8d4 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:32.401747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec994d0-d92a-40e9-91f8-6a67ac91a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:32.402183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec994d0-d92a-40e9-91f8-6a67ac91a8d4 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:32.403266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec994d0-d92a-40e9-91f8-6a67ac91a8d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:32.405561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec994d0-d92a-40e9-91f8-6a67ac91a8d4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:32.428105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 445/891] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:09:32 2022] POST /identity/v3/services => generated 241 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:32.661782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055536d-63e8-407d-bc2a-c2c80efbc6c9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:32.662284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055536d-63e8-407d-bc2a-c2c80efbc6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:32.662284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055536d-63e8-407d-bc2a-c2c80efbc6c9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:32.663842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 447/892] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:32.668893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04835d55-da45-4872-96e5-9b9c0cd7ff0f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:32.669174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04835d55-da45-4872-96e5-9b9c0cd7ff0f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:32.669444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04835d55-da45-4872-96e5-9b9c0cd7ff0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:32.690065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-04835d55-da45-4872-96e5-9b9c0cd7ff0f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:32.691644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-04835d55-da45-4872-96e5-9b9c0cd7ff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:32.774224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 446/893] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:32.874344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabdc12-b9ab-4d4f-a9cb-8c5ff785c6a5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:32.874673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabdc12-b9ab-4d4f-a9cb-8c5ff785c6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:32.874907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabdc12-b9ab-4d4f-a9cb-8c5ff785c6a5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:32.876563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 448/894] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:32.882397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f527c0-3f81-431d-9b06-e05eddb70962 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:32.882891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f527c0-3f81-431d-9b06-e05eddb70962 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:32.882966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f527c0-3f81-431d-9b06-e05eddb70962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:32.901918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-31f527c0-3f81-431d-9b06-e05eddb70962 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:32.903117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-31f527c0-3f81-431d-9b06-e05eddb70962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:32.982310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 447/895] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:33.070408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabdc12-b9ab-4d4f-a9cb-8c5ff785c6a5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:33.213692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabdc12-b9ab-4d4f-a9cb-8c5ff785c6a5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:33.276635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0143d6-f748-4d49-bbf5-cba794270e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:33.277628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0143d6-f748-4d49-bbf5-cba794270e98 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:33.278085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0143d6-f748-4d49-bbf5-cba794270e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:33.278543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0143d6-f748-4d49-bbf5-cba794270e98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:33.296957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0143d6-f748-4d49-bbf5-cba794270e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dd0143d6-f748-4d49-bbf5-cba794270e98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:33.306962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:33.308685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:33.311199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 449/896] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Oct 6 12:09:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:33.315521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f527c0-3f81-431d-9b06-e05eddb70962 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:33.327273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:33.330681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0143d6-f748-4d49-bbf5-cba794270e98 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:33.416864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:33.463666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f527c0-3f81-431d-9b06-e05eddb70962 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:33.487001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0143d6-f748-4d49-bbf5-cba794270e98 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:33.512148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:33.513051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:33.513202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:33.513421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:33.514203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:33.514513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:33.516003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:33.525844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:33.530935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 448/897] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Oct 6 12:09:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:33.531066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:33.531066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:33.531066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:33.531289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:33.532707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:33.534050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:33.542838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:33.543831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:33.544724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:33.547879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 450/898] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Oct 6 12:09:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:33.555757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:33.623106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:33.659964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be38f2-0df4-4978-9cfd-62c189d6d42b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:33.699098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37817a36-8bcb-490e-aa2a-3f0771be4189 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:33.705580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30c95f-d4a5-46d5-ad53-bab4f178a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:33.706531 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c95f-d4a5-46d5-ad53-bab4f178a87d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:33.707639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c95f-d4a5-46d5-ad53-bab4f178a87d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:33.708145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c95f-d4a5-46d5-ad53-bab4f178a87d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:33.709686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:33.727952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30c95f-d4a5-46d5-ad53-bab4f178a87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:33.729469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30c95f-d4a5-46d5-ad53-bab4f178a87d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:33.740246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a441f4-d984-4b0d-a75d-7b18cba5b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:33.740863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a441f4-d984-4b0d-a75d-7b18cba5b73c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:33.741144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a441f4-d984-4b0d-a75d-7b18cba5b73c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:33.741417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a441f4-d984-4b0d-a75d-7b18cba5b73c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:33.742089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a441f4-d984-4b0d-a75d-7b18cba5b73c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:33.742392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a441f4-d984-4b0d-a75d-7b18cba5b73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:33.743761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a441f4-d984-4b0d-a75d-7b18cba5b73c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6a30c95f-d4a5-46d5-ad53-bab4f178a87d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:33.746021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:33.747004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:33.748043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:33.748043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:33.748043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:33.748043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 449/899] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:33.748734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a2fde-320f-42cb-99a7-be560aa1f7a2 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:33.748734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a2fde-320f-42cb-99a7-be560aa1f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:33.748989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a2fde-320f-42cb-99a7-be560aa1f7a2 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:33.750393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 450/900] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:33.755139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a2fde-320f-42cb-99a7-be560aa1f7a2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:33.755750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 451/901] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:33.759231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f0b8-b96d-4246-a030-b73f8b33ce3e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:33.761419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f0b8-b96d-4246-a030-b73f8b33ce3e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:33.761948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f0b8-b96d-4246-a030-b73f8b33ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:33.783205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-77f2f0b8-b96d-4246-a030-b73f8b33ce3e None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:33.784306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-77f2f0b8-b96d-4246-a030-b73f8b33ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:33.857320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 452/902] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:33.858099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2f0b8-b96d-4246-a030-b73f8b33ce3e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:33.886275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a2fde-320f-42cb-99a7-be560aa1f7a2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:33.915477 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:33.930760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:33.931845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:33.932344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:33.932818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:33.933797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:33.934724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:33.937173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:33.952919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 451/903] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:33.959983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:33.975021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2f0b8-b96d-4246-a030-b73f8b33ce3e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:33.976714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:34.017009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.017648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.017932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.018207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.018846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:34.019191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.020750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.032511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 453/904] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:34.034195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.100369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052b16-121d-40d3-83d7-54f44a284eca None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:34.144661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.145305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.145614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.145890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.153857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.155414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:34.167818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:34.168814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 452/905] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:09:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:34.170096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.181636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac1cd8-f185-4654-8550-e1e5c0fbb35d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:34.221125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:34.225468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.226116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.226409 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.226687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.227402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] RBAC: Adding query filter params (interface=public, service_id=de14a4975ba2436fb259561980735c78, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:34.227718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.229080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.234313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 454/906] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Oct 6 12:09:34 2022] GET /identity/v3/endpoints?service_id=de14a4975ba2436fb259561980735c78&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:34.235595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.273477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:34.300323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060e64-5536-4efd-b7cf-2c7078167fbb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:34.336792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.337607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.337990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.338227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.338829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.340192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:34.349649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:34.350667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:34.351507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 453/907] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:34.352322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.362318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb9a0b-35b3-46ea-9fb4-3e8e5037ff88 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:34.408781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.409254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.409550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.409863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.410597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:34.410901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.412320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.437525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 455/908] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Oct 6 12:09:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:34.437525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.465035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927c19-60e4-4468-9f4e-78a429bad156 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:34.483459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:34.512642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f8d5-f5a2-423a-aa9c-c4a464ac4314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.513244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f8d5-f5a2-423a-aa9c-c4a464ac4314 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.513530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f8d5-f5a2-423a-aa9c-c4a464ac4314 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.513827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f8d5-f5a2-423a-aa9c-c4a464ac4314 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.514443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2f8d5-f5a2-423a-aa9c-c4a464ac4314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.515817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2f8d5-f5a2-423a-aa9c-c4a464ac4314 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.523265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 454/909] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:09:34 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:09:34.524076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f8d5-f5a2-423a-aa9c-c4a464ac4314 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.559944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:34.575867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc161acf-51b1-49ee-ad98-3d57b654db41 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:34.618154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.619251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.619748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.620165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.620957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:34.621416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.623091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.630821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 456/910] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:34.636660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.683409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f8d5-f5a2-423a-aa9c-c4a464ac4314 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:34.739553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294335cc-43d3-47f5-a887-8bf6dff3883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.740254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294335cc-43d3-47f5-a887-8bf6dff3883c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.740529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294335cc-43d3-47f5-a887-8bf6dff3883c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.740799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294335cc-43d3-47f5-a887-8bf6dff3883c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.764162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39815818-cac6-4e20-aa72-ce6bbf5ec36c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:34.789140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:34.816342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:34.817174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.817459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.817768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.818558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:34.818868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.820674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.823848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294335cc-43d3-47f5-a887-8bf6dff3883c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:34.825493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294335cc-43d3-47f5-a887-8bf6dff3883c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:34.828085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 457/911] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Oct 6 12:09:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:34.834406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.857029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:34.950774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 455/912] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:34 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:09:34.952304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc51df-300d-4088-b5a4-705c9366b862 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:34.952596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc51df-300d-4088-b5a4-705c9366b862 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:34.952872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc51df-300d-4088-b5a4-705c9366b862 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:34.955074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 456/913] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:34.958844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc51df-300d-4088-b5a4-705c9366b862 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:34.966353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3105b6-dbcb-4864-8b18-e7bf6dadfd5b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:35.012418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d74d62-7b2f-4dac-86db-287e00594b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:35.013038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74d62-7b2f-4dac-86db-287e00594b5e None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.013321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74d62-7b2f-4dac-86db-287e00594b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.013840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74d62-7b2f-4dac-86db-287e00594b5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.014360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74d62-7b2f-4dac-86db-287e00594b5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:35.016857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74d62-7b2f-4dac-86db-287e00594b5e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:35.041195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:35.041820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 458/914] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:09:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:35.043391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f86b9-57fb-4e21-83fe-d7f59f71d3ae None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.043708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f86b9-57fb-4e21-83fe-d7f59f71d3ae None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.043964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f86b9-57fb-4e21-83fe-d7f59f71d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.064377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-356f86b9-57fb-4e21-83fe-d7f59f71d3ae None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:35.065707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-356f86b9-57fb-4e21-83fe-d7f59f71d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:35.111027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc51df-300d-4088-b5a4-705c9366b862 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:35.160529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 459/915] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:35.165673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:35.165673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.165673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.165673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.178894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:35.180776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:35.198994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:35.200027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:35.200937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:35.200937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:35.200937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:35.203295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 457/916] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:35.211661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f86b9-57fb-4e21-83fe-d7f59f71d3ae None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:35.213869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:35.334035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f86b9-57fb-4e21-83fe-d7f59f71d3ae None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:35.370346 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:35.371334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.371830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.372344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.373207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:35.373735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:35.375825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:35.389074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 460/917] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:35.394389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:35.457009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:35.504086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df93ceb-1d07-46c5-92ba-aed3133513fd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:35.535126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:35.537397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:35.544218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:35.545256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.545775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.546254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.554342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:35.556199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:35.568604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:35.569509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:35.570433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:35.570433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:35.570433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:35.570433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:35.570433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:35.570433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:35.570433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:35.570433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:35.572772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 458/918] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:35.578309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:35.588507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f5536-e513-457b-8994-c216dd5301e4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:35.632301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:35.633482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.634285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.634795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.635682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:35.637764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:35.648561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:35.649895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:35.650742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:35.652877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 461/919] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:35.662431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:35.695286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ebe9b-a817-488e-aded-2f3c58838a6c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:35.731461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:35.732065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.732340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.732666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.733359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:35.733739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:35.736158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:35.754065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 459/920] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:35.759345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:35.809623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b03d6a-0d8b-4d26-a201-f6ee3e24915e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:35.820371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:35.861397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:35.862797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.863292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.863800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.864647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:35.865162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:35.869755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:35.871049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:35.881972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 462/921] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:35.884583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:35.889871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39708-871e-4070-956d-1a665c048b57 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:35.930328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:35.930995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:35.931267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:35.931529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:35.932311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] RBAC: Adding query filter params (role.id=2b4d2133304046c4a33aae2ed1758aaa, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=858b93ae249749b09d4a340668c3f970) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:35.932614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:35.934159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:35.949567 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 460/922] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:35 2022] GET /identity/v3/role_assignments?user.id=858b93ae249749b09d4a340668c3f970&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=2b4d2133304046c4a33aae2ed1758aaa => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:36.038088 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65024e-8348-4c84-b494-f807fc4bd103 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:36.083693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:36.084388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:36.084673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:36.084954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:36.085659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:36.085969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:36.087731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:36.094764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 463/923] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:36.103342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:36.218558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef41da2-e34b-442e-aba4-6fcc6f0a6e6c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:36.220724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:36.258134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b7960-a732-46aa-8f2f-e48deeaebfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:36.258746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b7960-a732-46aa-8f2f-e48deeaebfac None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:36.259023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b7960-a732-46aa-8f2f-e48deeaebfac None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:36.259291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b7960-a732-46aa-8f2f-e48deeaebfac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:36.259990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b7960-a732-46aa-8f2f-e48deeaebfac None admin] RBAC: Adding query filter params (interface=public, service_id=4870a87a53304b16a101681e2d26b232, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:36.260292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b7960-a732-46aa-8f2f-e48deeaebfac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:36.261682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b7960-a732-46aa-8f2f-e48deeaebfac None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:36.268026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 461/924] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Oct 6 12:09:36 2022] GET /identity/v3/endpoints?service_id=4870a87a53304b16a101681e2d26b232&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:36.273563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:36.347152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:36.395842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb622d-9d98-4611-b939-85b3fcd1c3a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:36.431990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfffcc-30d4-41a3-87bb-64e554e3fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:36.432600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfffcc-30d4-41a3-87bb-64e554e3fdef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:36.432888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfffcc-30d4-41a3-87bb-64e554e3fdef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:36.433158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfffcc-30d4-41a3-87bb-64e554e3fdef None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:36.433793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfffcc-30d4-41a3-87bb-64e554e3fdef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:36.435157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfffcc-30d4-41a3-87bb-64e554e3fdef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:36.442348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 464/925] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:09:36 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:09:36.919599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3e47-251d-4dbe-bfca-abad4c4144a3 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:36.919978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3e47-251d-4dbe-bfca-abad4c4144a3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:36.920254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3e47-251d-4dbe-bfca-abad4c4144a3 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:36.922068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 462/926] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:36.929040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21eab-85a5-4cdd-aecf-1b1c154ed7c0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:36.929711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21eab-85a5-4cdd-aecf-1b1c154ed7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:36.929711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21eab-85a5-4cdd-aecf-1b1c154ed7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:36.951657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-aed21eab-85a5-4cdd-aecf-1b1c154ed7c0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:36.952874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aed21eab-85a5-4cdd-aecf-1b1c154ed7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:37.025321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 465/927] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:37.296930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3e47-251d-4dbe-bfca-abad4c4144a3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:37.421798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3e47-251d-4dbe-bfca-abad4c4144a3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:37.460097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53689fe3-1148-475d-9eb4-0850bf343323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:37.460739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53689fe3-1148-475d-9eb4-0850bf343323 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:37.461021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53689fe3-1148-475d-9eb4-0850bf343323 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:37.461294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53689fe3-1148-475d-9eb4-0850bf343323 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:37.461912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53689fe3-1148-475d-9eb4-0850bf343323 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:37.463281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53689fe3-1148-475d-9eb4-0850bf343323 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-53689fe3-1148-475d-9eb4-0850bf343323 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:37.472949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:37.473975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:37.475471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 463/928] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Oct 6 12:09:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:37.480331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed21eab-85a5-4cdd-aecf-1b1c154ed7c0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:37.486040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc328a1-57fe-4e7c-860f-3fbcbe83fcf0 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:37.486763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc328a1-57fe-4e7c-860f-3fbcbe83fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:37.487262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc328a1-57fe-4e7c-860f-3fbcbe83fcf0 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:37.488857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 464/929] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:37.494778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac0b5-16f3-46e2-8005-7ac9bf7ebb74 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:37.495061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac0b5-16f3-46e2-8005-7ac9bf7ebb74 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:37.495339 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac0b5-16f3-46e2-8005-7ac9bf7ebb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:37.514793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-62bac0b5-16f3-46e2-8005-7ac9bf7ebb74 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:37.516682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-62bac0b5-16f3-46e2-8005-7ac9bf7ebb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:37.539924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:37.544668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:37.594875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed21eab-85a5-4cdd-aecf-1b1c154ed7c0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:37.600645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 465/930] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:37.631533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:37.632518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:37.633030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:37.633509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:37.634496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:37.635025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:37.636592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:37.647069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 466/931] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:37.648689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bac0b5-16f3-46e2-8005-7ac9bf7ebb74 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:37.755872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bac0b5-16f3-46e2-8005-7ac9bf7ebb74 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:37.802301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:37.802913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:37.803190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:37.803456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:37.804089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:37.804385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:37.805779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:37.811897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 466/932] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:37.818352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:37.890376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:37.918902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:37.941144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023a49e-f032-40e7-adcb-ed0b742eafd1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:37.959601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:37.986147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a44e28-8127-489a-9a49-0225c93a24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:37.986796 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44e28-8127-489a-9a49-0225c93a24fa None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:37.987081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44e28-8127-489a-9a49-0225c93a24fa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:37.987355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44e28-8127-489a-9a49-0225c93a24fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:37.988045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a44e28-8127-489a-9a49-0225c93a24fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:37.989425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a44e28-8127-489a-9a49-0225c93a24fa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:38.017867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 467/933] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:09:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:38.018204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6e2b7-f9d4-49bf-827d-f1cfb539f5af None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:38.069406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:38.070356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:38.070845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:38.071296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:38.072207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:38.073913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:38.076934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING keystone.server.flask.common [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 06 12:09:38.097925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.sql.core [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 12:09:38.097925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 06 12:09:38.097925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [parameters: {'id': 'd2f4af23660545eda6982d2e75723067', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 06 12:09:38.097925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81448) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e334bbd7-dd80-4dde-bc94-6f12a2457297 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d2f4af23660545eda6982d2e75723067.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d2f4af23660545eda6982d2e75723067. Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application conn.query(q) Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:09:38.116897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result.read() Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 06 12:09:38.117851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application next(self.gen) Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application yield resource Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application next(self.gen) Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise self.value Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application session.commit() Oct 06 12:09:38.118798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.session.flush() Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application compat.raise_( Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 12:09:38.119742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 12:09:38.120901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application conn.query(q) Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result.read() Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:09:38.121861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [parameters: {'id': 'd2f4af23660545eda6982d2e75723067', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:38.122777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:38.123566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d2f4af23660545eda6982d2e75723067. Oct 06 12:09:38.124605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:38.128051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 467/934] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Oct 6 12:09:37 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:38.141417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a44e28-8127-489a-9a49-0225c93a24fa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:38.256508 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e370fda-5fd0-4440-9622-01ac1c8bf5be None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:38.256850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e370fda-5fd0-4440-9622-01ac1c8bf5be None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:38.257054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e370fda-5fd0-4440-9622-01ac1c8bf5be None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:38.259774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a44e28-8127-489a-9a49-0225c93a24fa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:38.261353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 468/935] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:38.267008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d9d4-5f95-4f5c-ac7b-297824930336 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:38.267287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d9d4-5f95-4f5c-ac7b-297824930336 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:38.267564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d9d4-5f95-4f5c-ac7b-297824930336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:38.291042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5016d9d4-5f95-4f5c-ac7b-297824930336 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:38.298637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5016d9d4-5f95-4f5c-ac7b-297824930336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:38.310761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:38.312235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:38.313842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:38.314495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:38.323371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:38.325165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:38.340623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:38.341665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:38.342617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:38.342617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:38.342617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:38.342617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:38.342617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:38.342617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:38.342617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:38.342617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:38.345904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 468/936] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:38.351536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:38.390220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 469/937] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:38.391513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:38.494159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a3c0-22cd-4009-9b74-20f4d701a92f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:38.544693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:38.545620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:38.546052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:38.546497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:38.548506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:38.548968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:38.550595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:38.576157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 469/938] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:38.666044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016d9d4-5f95-4f5c-ac7b-297824930336 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:38.676561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:38.796398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016d9d4-5f95-4f5c-ac7b-297824930336 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:38.840234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d29cb-537b-4024-84e5-bd2b44d4e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:38.840876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d29cb-537b-4024-84e5-bd2b44d4e783 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:38.841152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d29cb-537b-4024-84e5-bd2b44d4e783 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:38.841426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d29cb-537b-4024-84e5-bd2b44d4e783 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:38.855024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d29cb-537b-4024-84e5-bd2b44d4e783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-da5d29cb-537b-4024-84e5-bd2b44d4e783 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:38.860378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:38.861345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:38.864252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 470/939] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Oct 6 12:09:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:38.867951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:38.937205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d741-d6f0-48bf-8767-53c0983d130e None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:38.937385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d741-d6f0-48bf-8767-53c0983d130e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:38.938562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d741-d6f0-48bf-8767-53c0983d130e None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:38.940423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 471/940] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:38.946359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee263eb-f5bc-4361-90b7-7c24a84fd7db None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:38.946639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee263eb-f5bc-4361-90b7-7c24a84fd7db None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:38.946910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee263eb-f5bc-4361-90b7-7c24a84fd7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:38.968300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1ee263eb-f5bc-4361-90b7-7c24a84fd7db None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:38.969926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1ee263eb-f5bc-4361-90b7-7c24a84fd7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:38.979995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:38.993121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7b397-ab27-4832-ae79-20bda74a4830 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:39.032880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:39.033501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:39.033817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:39.034095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:39.034778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:39.035091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:39.036483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:39.044080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:39.049676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 470/941] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Oct 6 12:09:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:39.051691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.055731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 472/942] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:39.157950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530773-fd92-4060-a319-8d5a2814e6e0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:39.194510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:39.195062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:39.195349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:39.195627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:39.207684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:39.210106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:39.230318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:39.231455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:39.232500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:39.232500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:39.232500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:39.232674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 471/943] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:39.240563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee263eb-f5bc-4361-90b7-7c24a84fd7db None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.380469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee263eb-f5bc-4361-90b7-7c24a84fd7db None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:39.388794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.393417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:39.429419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:39.430390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:39.430673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:39.431854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:39.432518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:39.432818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:39.434366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:39.450497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 473/944] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:39.457209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.521675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a0fe-8fc5-4eba-977b-06d5652ad79a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:39.534260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:39.566037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:39.566677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:39.566973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:39.567230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:39.567832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:39.569331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:39.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:39.580523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:39.581370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:39.585804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 472/945] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:39.587170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.589916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f091d9-8e4b-4caa-b48b-e81e9b7afa94 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:39.629010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:39.630142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:39.630623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:39.631107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:39.639527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:39.641875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:39.654566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:39.655564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:39.657075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:39.664484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 474/946] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:09:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:39.665669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.665779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:39.705964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfedb8-a30e-483c-83d4-bbd708c3ecf7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:39.745850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:39.746465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:39.746763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:39.747079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:39.747725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:39.748028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:39.749397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:39.757283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 473/947] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:39.763273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.782957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8860cc-e223-4da8-8b5f-aa2201a46c1b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:39.807753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:39.832289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:39.832911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:39.833216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:39.833749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:39.834562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:39.834866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:39.837048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:39.865028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 475/948] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Oct 6 12:09:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:39.866198 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.911859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c01944-75f7-4ef2-9dff-93f9adba260c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:39.950674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:39.956435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:39.956901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:39.957178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:39.957835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:39.958505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:39.958809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:39.961160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:39.967086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 474/949] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:39.974568 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:39.998397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefbb0d-9bc5-4daa-bef1-a0785ee2ac1a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:40.052863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:40.054562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.055029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.055473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.068976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:40.071023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:40.085953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a25b37-bf7e-456b-b70e-2c5adc4a84f9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:40.091960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:40.092980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:40.094963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:40.094963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:40.094963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:40.102206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 476/950] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:40.103409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:40.141906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:40.144291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429b4fa-731d-4beb-9b82-3ce61b66160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:40.145703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429b4fa-731d-4beb-9b82-3ce61b66160a None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.146169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429b4fa-731d-4beb-9b82-3ce61b66160a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.147420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429b4fa-731d-4beb-9b82-3ce61b66160a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.148695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429b4fa-731d-4beb-9b82-3ce61b66160a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:40.150766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429b4fa-731d-4beb-9b82-3ce61b66160a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:40.180754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 475/951] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:09:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:40.255921 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1a2d-ce00-4700-ad7f-71087a92850b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:40.316572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f739-1826-4f8a-a5e3-686de69737f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:40.317521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f739-1826-4f8a-a5e3-686de69737f4 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.318024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f739-1826-4f8a-a5e3-686de69737f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.318485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f739-1826-4f8a-a5e3-686de69737f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.319335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f739-1826-4f8a-a5e3-686de69737f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:40.319826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f739-1826-4f8a-a5e3-686de69737f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:40.321387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f739-1826-4f8a-a5e3-686de69737f4 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:40.336637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 477/952] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:40.342180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429b4fa-731d-4beb-9b82-3ce61b66160a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:40.375464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7471a0-8c0e-4f10-be29-2640c068c975 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.375772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7471a0-8c0e-4f10-be29-2640c068c975 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.376026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7471a0-8c0e-4f10-be29-2640c068c975 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.377822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 478/953] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:40.383534 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec116eb-9280-474d-b9f1-1949b1445544 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.384186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec116eb-9280-474d-b9f1-1949b1445544 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.384186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec116eb-9280-474d-b9f1-1949b1445544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.404736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4ec116eb-9280-474d-b9f1-1949b1445544 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:40.406005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4ec116eb-9280-474d-b9f1-1949b1445544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:40.409387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:40.493851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429b4fa-731d-4beb-9b82-3ce61b66160a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:40.499603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 479/954] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:40.531653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:40.533090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.533377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.533689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.543481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:40.544976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:40.564120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:40.565188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:40.566217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:40.566217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:40.566217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:40.566217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:40.566217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:40.566217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:40.566217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:40.566217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:40.566684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 476/955] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:40.571866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec116eb-9280-474d-b9f1-1949b1445544 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:40.589103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:40.686605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec116eb-9280-474d-b9f1-1949b1445544 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:40.725992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:40.726611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.726894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.727172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.727877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:40.728186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:40.729749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:40.743716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 480/956] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:40.750700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:40.787866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:40.867446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6dda3-0e74-42fc-840d-137e29ba2e4d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:40.876160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:40.879965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:40.912429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f35933-24e5-47b0-9eff-fd6c1f0b199a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:40.913208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ba04-7693-4247-8476-2b611334c2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:40.914198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ba04-7693-4247-8476-2b611334c2a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.914689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ba04-7693-4247-8476-2b611334c2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.915380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ba04-7693-4247-8476-2b611334c2a9 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/858b93ae249749b09d4a340668c3f970/roles/2b4d2133304046c4a33aae2ed1758aaa` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.918998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925ba04-7693-4247-8476-2b611334c2a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=858b93ae249749b09d4a340668c3f970, role_id=2b4d2133304046c4a33aae2ed1758aaa)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:40.920727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925ba04-7693-4247-8476-2b611334c2a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:40.949656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 477/957] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:09:40 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/858b93ae249749b09d4a340668c3f970/roles/2b4d2133304046c4a33aae2ed1758aaa => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:09:40.985080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116e2ae-2cda-411a-9eaa-106e0c56d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:40.986472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e2ae-2cda-411a-9eaa-106e0c56d83e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:40.987029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e2ae-2cda-411a-9eaa-106e0c56d83e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:40.987533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116e2ae-2cda-411a-9eaa-106e0c56d83e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:40.988432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116e2ae-2cda-411a-9eaa-106e0c56d83e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:40.990219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116e2ae-2cda-411a-9eaa-106e0c56d83e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3116e2ae-2cda-411a-9eaa-106e0c56d83e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:41.000665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:41.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:41.003574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:41.006937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 481/958] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:41.013478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ba04-7693-4247-8476-2b611334c2a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:41.083263 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bdc76-0578-461d-96a2-519ab104c69c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:41.083862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bdc76-0578-461d-96a2-519ab104c69c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:41.084348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bdc76-0578-461d-96a2-519ab104c69c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:41.086429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 482/959] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:41.097830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f3712-eff6-48dd-b499-a597702edbb6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:41.098572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f3712-eff6-48dd-b499-a597702edbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:41.098572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f3712-eff6-48dd-b499-a597702edbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:41.119942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ff0f3712-eff6-48dd-b499-a597702edbb6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:41.121749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ff0f3712-eff6-48dd-b499-a597702edbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:41.153504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ba04-7693-4247-8476-2b611334c2a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:41.202327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:41.203968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:41.204341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:41.204620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:41.205452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:41.206139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:41.207560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:41.213771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 478/960] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:41.218594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 483/961] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:41.220039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:41.257180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:41.346700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8824c-bfec-415d-ad69-8d6cf376cdf0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:41.391074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:41.391798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:41.392137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:41.392555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:41.393405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:41.393737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:41.395165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:41.401395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 479/962] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:41.521684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f3712-eff6-48dd-b499-a597702edbb6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:41.611730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:41.651255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f3712-eff6-48dd-b499-a597702edbb6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:41.692583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:41.693204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:41.693485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:41.693784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:41.694441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:41.695968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:41.712335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.sql.core [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 12:09:41.712335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 06 12:09:41.712335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [parameters: {'user_id': 'd35a9c0bf6844a26a3fa4d9f3a8e4bbb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 06 12:09:41.712335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81448) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application conn.query(q) Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result.read() Oct 06 12:09:41.720236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 12:09:41.721204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application next(self.gen) Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application yield resource Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application next(self.gen) Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.session.rollback() Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.force_reraise() Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise self.value Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application session.commit() Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 06 12:09:41.722232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._prepare_impl() Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.session.flush() Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._flush(objects) Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application compat.raise_( Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application flush_context.execute() Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rec.execute(self) Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 06 12:09:41.723155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 06 12:09:41.724082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result = self._query(query) Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application conn.query(q) Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application result.read() Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 06 12:09:41.724978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd35a9c0bf6844a26a3fa4d9f3a8e4bbb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:41.727239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 06 12:09:41.729205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 06 12:09:41.738250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 06 12:09:41.738250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 06 12:09:41.738250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 06 12:09:41.738250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 06 12:09:41.738250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 06 12:09:41.738250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:41.738250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 484/963] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Oct 6 12:09:41 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:41.739363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:41.839891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:41.844937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5e9e-b7b7-4855-874e-3434edd6e98b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:41.881430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4a6ad-da53-4333-a441-624c29dba71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:41.882110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4a6ad-da53-4333-a441-624c29dba71e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:41.882394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4a6ad-da53-4333-a441-624c29dba71e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:41.882670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4a6ad-da53-4333-a441-624c29dba71e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:41.891595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4a6ad-da53-4333-a441-624c29dba71e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:41.893137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4a6ad-da53-4333-a441-624c29dba71e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-86c4a6ad-da53-4333-a441-624c29dba71e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:41.905472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:41.907900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:41.910195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 480/964] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:41.917592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:42.064729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62ebf9-ddbe-450a-9975-2f3502ab88e3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:42.109981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea3e7b-5d5a-4fe2-8a99-98b6ef1f09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:42.110656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea3e7b-5d5a-4fe2-8a99-98b6ef1f09af None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:42.110850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea3e7b-5d5a-4fe2-8a99-98b6ef1f09af None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:42.111112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea3e7b-5d5a-4fe2-8a99-98b6ef1f09af None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:42.111816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea3e7b-5d5a-4fe2-8a99-98b6ef1f09af None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:42.112113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea3e7b-5d5a-4fe2-8a99-98b6ef1f09af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:42.113936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea3e7b-5d5a-4fe2-8a99-98b6ef1f09af None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:42.115778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:42.161940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 485/965] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Oct 6 12:09:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:42.676200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67141-49f9-4dac-bd31-429c37d02d30 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:42.676200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67141-49f9-4dac-bd31-429c37d02d30 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:42.676200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67141-49f9-4dac-bd31-429c37d02d30 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:42.678732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 481/966] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:42.684709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77529-f32e-42a0-9ee6-33c0a61e7d19 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:42.685192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77529-f32e-42a0-9ee6-33c0a61e7d19 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:42.685291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77529-f32e-42a0-9ee6-33c0a61e7d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:42.705062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9fa77529-f32e-42a0-9ee6-33c0a61e7d19 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:42.706816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9fa77529-f32e-42a0-9ee6-33c0a61e7d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:42.801578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 486/967] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:43.072220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e67141-49f9-4dac-bd31-429c37d02d30 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:43.196210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e67141-49f9-4dac-bd31-429c37d02d30 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:43.233003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016c216-5542-4da5-bf51-881905663e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:43.233685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016c216-5542-4da5-bf51-881905663e4c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.233978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016c216-5542-4da5-bf51-881905663e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.234573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016c216-5542-4da5-bf51-881905663e4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.235709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016c216-5542-4da5-bf51-881905663e4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:43.237114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016c216-5542-4da5-bf51-881905663e4c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:43.244979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9da7-ec17-4832-9bd5-1dc1db474710 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.245257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9da7-ec17-4832-9bd5-1dc1db474710 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.245530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9da7-ec17-4832-9bd5-1dc1db474710 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a016c216-5542-4da5-bf51-881905663e4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:43.246850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:43.248454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:43.250792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:43.251660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 487/968] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:43.251734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 482/969] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:43.254382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d9da7-ec17-4832-9bd5-1dc1db474710 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:43.256867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1cd5-ca58-4c13-8f2c-e2425696fe8c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.257473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1cd5-ca58-4c13-8f2c-e2425696fe8c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.257791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1cd5-ca58-4c13-8f2c-e2425696fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.280543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dcab1cd5-ca58-4c13-8f2c-e2425696fe8c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:43.282898 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dcab1cd5-ca58-4c13-8f2c-e2425696fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:43.301667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:43.363589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 483/970] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:43.373763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d9da7-ec17-4832-9bd5-1dc1db474710 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:43.397924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:43.420334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:43.420952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.421227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.421497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.423108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:43.423554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:43.425363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:43.431149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 488/971] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:43.436606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1cd5-ca58-4c13-8f2c-e2425696fe8c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:43.550456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1cd5-ca58-4c13-8f2c-e2425696fe8c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:43.594954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:43.595610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.595895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.596173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.596848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:43.597159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:43.598646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:43.604704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 484/972] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:43.610657 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:43.655658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:43.676664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:43.728401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25239e-a706-4335-86e9-727cd2eb8a1f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:43.764291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f71e2d-2273-41d9-bf1c-b70ef0497a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:43.764900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f71e2d-2273-41d9-bf1c-b70ef0497a77 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.765179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f71e2d-2273-41d9-bf1c-b70ef0497a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.765507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f71e2d-2273-41d9-bf1c-b70ef0497a77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.766667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f71e2d-2273-41d9-bf1c-b70ef0497a77 None admin] RBAC: Adding query filter params (interface=admin, service_id=4870a87a53304b16a101681e2d26b232, region_id=RegionOne) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:43.766982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f71e2d-2273-41d9-bf1c-b70ef0497a77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:43.768380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f71e2d-2273-41d9-bf1c-b70ef0497a77 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:43.773476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 489/973] 10.222.0.15 () {56 vars in 1249 bytes} [Thu Oct 6 12:09:43 2022] GET /identity/v3/endpoints?service_id=4870a87a53304b16a101681e2d26b232&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:43.774987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab166b-16cb-412f-8879-8e12c19b6ded None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.775271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab166b-16cb-412f-8879-8e12c19b6ded None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.775545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab166b-16cb-412f-8879-8e12c19b6ded None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.776797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 490/974] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:43.782774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab166b-16cb-412f-8879-8e12c19b6ded None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:43.786647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e72e-a707-462d-9096-8adae536a8be None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:43.824442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e422bd-4680-4da1-8b69-16a12dd47069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:43.825077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e422bd-4680-4da1-8b69-16a12dd47069 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.825362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e422bd-4680-4da1-8b69-16a12dd47069 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.825800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e422bd-4680-4da1-8b69-16a12dd47069 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.832445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:43.837337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e422bd-4680-4da1-8b69-16a12dd47069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-97e422bd-4680-4da1-8b69-16a12dd47069 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:43.844023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:43.845132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:43.846044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 485/975] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Oct 6 12:09:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:43.847423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322b227-f9d1-4d4f-bd7b-d1576314bc27 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.847636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322b227-f9d1-4d4f-bd7b-d1576314bc27 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.847974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322b227-f9d1-4d4f-bd7b-d1576314bc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.869829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f322b227-f9d1-4d4f-bd7b-d1576314bc27 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:43.871053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f322b227-f9d1-4d4f-bd7b-d1576314bc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:43.893440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab166b-16cb-412f-8879-8e12c19b6ded None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:43.929571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6c0f-7799-4919-8655-34eaff454dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:43.930104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6c0f-7799-4919-8655-34eaff454dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:43.930386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6c0f-7799-4919-8655-34eaff454dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:43.930661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6c0f-7799-4919-8655-34eaff454dc6 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:43.931264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6c0f-7799-4919-8655-34eaff454dc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:43.932633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6c0f-7799-4919-8655-34eaff454dc6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:43.939133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 491/976] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:09:43 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:09:43.939918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6c0f-7799-4919-8655-34eaff454dc6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:43.940546 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 486/977] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:44.054494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6c0f-7799-4919-8655-34eaff454dc6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:44.065859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:44.097779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:44.098760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:44.099218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:44.099658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:44.100346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:44.100655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:44.102262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:44.111910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 492/978] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Oct 6 12:09:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:44.117662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322b227-f9d1-4d4f-bd7b-d1576314bc27 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:44.128291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:44.221786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:44.238453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322b227-f9d1-4d4f-bd7b-d1576314bc27 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:44.284042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:44.284674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:44.284956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:44.285275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:44.297491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:44.299104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:44.315682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:44.316727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:44.318105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:44.318105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:44.318105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:44.318105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 487/979] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:44.322348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:44.341735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285bb55-1a58-43cf-a436-beda1e9cb7d7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:44.386891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948edfa2-73ae-41eb-9e86-88428f459744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:44.387363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948edfa2-73ae-41eb-9e86-88428f459744 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:44.387810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948edfa2-73ae-41eb-9e86-88428f459744 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:44.388251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948edfa2-73ae-41eb-9e86-88428f459744 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:44.389418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948edfa2-73ae-41eb-9e86-88428f459744 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:44.391835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948edfa2-73ae-41eb-9e86-88428f459744 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:44.393613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:44.417611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 493/980] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:09:44 2022] POST /identity/v3/services => generated 242 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:44.457105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d40ef0-065c-4846-8c50-015cef039465 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:44.504014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:44.504563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:44.504852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:44.505128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:44.505826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:44.506134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:44.507538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:44.526680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 488/981] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:44.528599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948edfa2-73ae-41eb-9e86-88428f459744 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:44.566155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:44.644812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948edfa2-73ae-41eb-9e86-88428f459744 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:44.682007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:44.682651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:44.682981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:44.683255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:44.691773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:44.693301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:44.706295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:44.707340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 06 12:09:44.708309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:44.709607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 494/982] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:09:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:44.713435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:44.822895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b965-077d-4283-b7ab-aa27501b22ee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:44.839446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:44.864435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:44.865066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:44.865350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:44.865685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:44.866447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:44.866760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:44.868202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:44.892498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 489/983] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Oct 6 12:09:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:44.894211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:45.004132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:45.014970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b08b-d6f0-4c05-b997-162964c60bfb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:45.050181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2a206-f332-4bd7-8251-5862953baa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:45.050792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2a206-f332-4bd7-8251-5862953baa05 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:45.051124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2a206-f332-4bd7-8251-5862953baa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:45.051400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2a206-f332-4bd7-8251-5862953baa05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:45.138949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2a206-f332-4bd7-8251-5862953baa05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:45.141268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2a206-f332-4bd7-8251-5862953baa05 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:45.237729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:45.250577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 495/984] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:44 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:09:45.257309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:45.380720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c2e71-4f40-4200-8e3b-09f700878d47 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:45.429647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:45.430299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:45.430590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:45.430861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:45.441756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:45.443219 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:45.469793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:45.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:45.471864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:45.471864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:45.471864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:45.471864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 490/985] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:45.479451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2a206-f332-4bd7-8251-5862953baa05 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:45.595297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2a206-f332-4bd7-8251-5862953baa05 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:45.632929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fb265-1213-4144-bbae-717956848cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:45.633457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb265-1213-4144-bbae-717956848cda None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:45.633761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb265-1213-4144-bbae-717956848cda None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:45.634038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb265-1213-4144-bbae-717956848cda None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:45.634685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fb265-1213-4144-bbae-717956848cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:45.634989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fb265-1213-4144-bbae-717956848cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:45.636364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fb265-1213-4144-bbae-717956848cda None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:45.654288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 496/986] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:45.655730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:45.684609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:45.760604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f144-c19f-4fa6-9296-fbaa7431d460 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:45.797594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:45.798245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:45.798526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:45.798874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:45.806356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:45.807803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:45.819728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:45.820747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:45.821868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 491/987] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:45.829952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fb265-1213-4144-bbae-717956848cda None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:45.885067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:45.938653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fb265-1213-4144-bbae-717956848cda None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:45.987916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87833be-d1eb-4e32-97f4-a12eff99ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:45.988539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87833be-d1eb-4e32-97f4-a12eff99ab9b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:45.988813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87833be-d1eb-4e32-97f4-a12eff99ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:45.989086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87833be-d1eb-4e32-97f4-a12eff99ab9b None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:45.989811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87833be-d1eb-4e32-97f4-a12eff99ab9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:45.990116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87833be-d1eb-4e32-97f4-a12eff99ab9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:45.991544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87833be-d1eb-4e32-97f4-a12eff99ab9b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:46.010843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 497/988] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:46.012381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:46.117017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:46.154154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704f6da-420a-4848-9b66-d630c124a626 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:46.211304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b75cf-c7a5-4497-ba32-4beea54e6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:46.211924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b75cf-c7a5-4497-ba32-4beea54e6517 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:46.212205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b75cf-c7a5-4497-ba32-4beea54e6517 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:46.212478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b75cf-c7a5-4497-ba32-4beea54e6517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:46.213209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b75cf-c7a5-4497-ba32-4beea54e6517 None admin] RBAC: Adding query filter params (role.id=2b4d2133304046c4a33aae2ed1758aaa, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=858b93ae249749b09d4a340668c3f970) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:46.213520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b75cf-c7a5-4497-ba32-4beea54e6517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:46.214972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b75cf-c7a5-4497-ba32-4beea54e6517 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:46.223867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 492/989] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:46 2022] GET /identity/v3/role_assignments?user.id=858b93ae249749b09d4a340668c3f970&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=2b4d2133304046c4a33aae2ed1758aaa => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:46.270855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345762bf-180f-4bf0-9132-9e6975bc936c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:46.271134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345762bf-180f-4bf0-9132-9e6975bc936c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:46.271563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345762bf-180f-4bf0-9132-9e6975bc936c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:46.273094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 498/990] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:46.279433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d895ac-360d-4544-9ec5-df6f90617b75 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:46.279750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d895ac-360d-4544-9ec5-df6f90617b75 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:46.279993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d895ac-360d-4544-9ec5-df6f90617b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:46.300055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-52d895ac-360d-4544-9ec5-df6f90617b75 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:46.301320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-52d895ac-360d-4544-9ec5-df6f90617b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:46.407351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 493/991] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:46.644578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1eeac-158a-4980-a19e-f61dedecd30a None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:46.644955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1eeac-158a-4980-a19e-f61dedecd30a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:46.645135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1eeac-158a-4980-a19e-f61dedecd30a None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:46.646672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 499/992] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:46.653112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1815-735a-47d0-aa2b-029408029631 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:46.653112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1815-735a-47d0-aa2b-029408029631 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:46.653112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1815-735a-47d0-aa2b-029408029631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:46.671219 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d2fe1815-735a-47d0-aa2b-029408029631 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:46.673322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d2fe1815-735a-47d0-aa2b-029408029631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:46.682427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1eeac-158a-4980-a19e-f61dedecd30a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:46.752785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 494/993] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:46.799519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1eeac-158a-4980-a19e-f61dedecd30a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:46.815920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:46.855392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:46.856397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:46.856869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:46.857291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:46.858366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:46.861620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:46.871029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:46.872014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:46.873218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 500/994] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Oct 6 12:09:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:46.878440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe1815-735a-47d0-aa2b-029408029631 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:46.890358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:46.992972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe1815-735a-47d0-aa2b-029408029631 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:47.021865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:47.033992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:47.034624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:47.034897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:47.035168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:47.035802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:47.036111 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:47.037475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:47.042523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 495/995] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:47.048698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:47.137461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:47.156959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbac8b-b735-4a84-933e-7743c7fed59c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:47.178981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718cd7c-e43d-4b35-9b1d-057c25f1842e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:47.198574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:47.199214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:47.199496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:47.199767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:47.200357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:47.201765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:47.211943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:47.213105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:47.214323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 501/996] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:47.219818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:47.224191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:47.224810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:47.225098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:47.225374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:47.226045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:47.226351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:47.227710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:47.233508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 496/997] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Oct 6 12:09:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:47.240530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:47.268812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:47.338705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34196cd0-6a03-45b5-8ca4-c23341532c42 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:47.360793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f77556-88b3-4fcb-9a6c-bba0579e3f38 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:47.375935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:47.376660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:47.376935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:47.377204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:47.377862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:47.378154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:47.379515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:47.385583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 502/998] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:47.391099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:47.401578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc5142-b779-4660-9dac-18e999133868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:47.402184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5142-b779-4660-9dac-18e999133868 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:47.402464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5142-b779-4660-9dac-18e999133868 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:47.402734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5142-b779-4660-9dac-18e999133868 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:47.403404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc5142-b779-4660-9dac-18e999133868 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:47.404751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc5142-b779-4660-9dac-18e999133868 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:47.411174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:47.433581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 497/999] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:09:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:09:47.527400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750be53-7d36-484a-8b07-7dd3efbe143c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:47.529062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:47.578541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:47.579195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:47.579479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:47.579759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:47.580394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:47.580699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:47.582168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:47.587750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 503/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:47.593964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc5142-b779-4660-9dac-18e999133868 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:47.705318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc5142-b779-4660-9dac-18e999133868 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:47.739456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f982-6523-4fb7-9257-4746a1a3617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:47.740126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f982-6523-4fb7-9257-4746a1a3617d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:47.740412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f982-6523-4fb7-9257-4746a1a3617d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:47.740682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f982-6523-4fb7-9257-4746a1a3617d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:47.741418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6f982-6523-4fb7-9257-4746a1a3617d None admin] RBAC: Adding query filter params (interface=public, service_id=72a74f97740b4334902290a1e3715458, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:47.741753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6f982-6523-4fb7-9257-4746a1a3617d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:47.743120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6f982-6523-4fb7-9257-4746a1a3617d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:47.748566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 498/1001] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Oct 6 12:09:47 2022] GET /identity/v3/endpoints?service_id=72a74f97740b4334902290a1e3715458&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:47.755177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:47.863463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a911f7-9f97-41e5-adb3-cd39039ee7fd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:47.904805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb325-d0a2-4dcc-8ed1-9e05b480a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:47.905410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb325-d0a2-4dcc-8ed1-9e05b480a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:47.906509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb325-d0a2-4dcc-8ed1-9e05b480a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:47.906829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb325-d0a2-4dcc-8ed1-9e05b480a9b7 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:47.907445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb325-d0a2-4dcc-8ed1-9e05b480a9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:47.908807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb325-d0a2-4dcc-8ed1-9e05b480a9b7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:47.920004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 504/1002] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:09:47 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:09:48.481416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abb5eb-f58e-4d40-9500-06495daa4ffa None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:48.481944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abb5eb-f58e-4d40-9500-06495daa4ffa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:48.481944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abb5eb-f58e-4d40-9500-06495daa4ffa None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:48.483440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 499/1003] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:48.488763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef34292-b35a-4e23-b6c2-ff30001c2f34 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:48.489221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef34292-b35a-4e23-b6c2-ff30001c2f34 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:48.489306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef34292-b35a-4e23-b6c2-ff30001c2f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:48.508997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1ef34292-b35a-4e23-b6c2-ff30001c2f34 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:48.510218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1ef34292-b35a-4e23-b6c2-ff30001c2f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:48.532504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:48.586054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 505/1004] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:48.862280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abb5eb-f58e-4d40-9500-06495daa4ffa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:48.930194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:48.976965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abb5eb-f58e-4d40-9500-06495daa4ffa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:49.011305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:49.011931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:49.012211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:49.012483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] PATH_INFO: `/v3/services/image` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:49.013061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:49.014525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:49.024592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:49.029887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:49.030947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 500/1005] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Oct 6 12:09:48 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:49.031877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef34292-b35a-4e23-b6c2-ff30001c2f34 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:49.142206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef34292-b35a-4e23-b6c2-ff30001c2f34 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:49.179384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2f37-cc37-4bd1-9cd6-0cda29e331e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:49.180011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2f37-cc37-4bd1-9cd6-0cda29e331e1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:49.180280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2f37-cc37-4bd1-9cd6-0cda29e331e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:49.180550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2f37-cc37-4bd1-9cd6-0cda29e331e1 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:49.181181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2f37-cc37-4bd1-9cd6-0cda29e331e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:49.181478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2f37-cc37-4bd1-9cd6-0cda29e331e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:49.182867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2f37-cc37-4bd1-9cd6-0cda29e331e1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:49.193690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 506/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:49.194679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:49.297878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3dce-5443-4698-ac67-28025e31798e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:49.326869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:49.347941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613f41e-31c4-47ed-9f6d-ac3d5e524fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:49.348564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613f41e-31c4-47ed-9f6d-ac3d5e524fcc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:49.348849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613f41e-31c4-47ed-9f6d-ac3d5e524fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:49.349111 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613f41e-31c4-47ed-9f6d-ac3d5e524fcc None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:49.349789 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613f41e-31c4-47ed-9f6d-ac3d5e524fcc None admin] RBAC: Adding query filter params (type=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:49.350092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613f41e-31c4-47ed-9f6d-ac3d5e524fcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:49.351455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613f41e-31c4-47ed-9f6d-ac3d5e524fcc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:49.361792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 501/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:49.677599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4bfb-9b4a-4632-9081-2b182bc1ae20 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:49.678132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4bfb-9b4a-4632-9081-2b182bc1ae20 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:49.678132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4bfb-9b4a-4632-9081-2b182bc1ae20 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:49.679651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 507/1008] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:49.684995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4491e-ad65-49c1-a33f-b19e8a5badeb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:49.685484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4491e-ad65-49c1-a33f-b19e8a5badeb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:49.685718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4491e-ad65-49c1-a33f-b19e8a5badeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:49.706229 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-83c4491e-ad65-49c1-a33f-b19e8a5badeb None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:49.707530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-83c4491e-ad65-49c1-a33f-b19e8a5badeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:49.777580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 502/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:50.047216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd4bfb-9b4a-4632-9081-2b182bc1ae20 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:50.070060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:50.125065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecbcb-f590-43ee-96a7-8231579a674b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:50.125065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecbcb-f590-43ee-96a7-8231579a674b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:50.125488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecbcb-f590-43ee-96a7-8231579a674b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:50.127151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 503/1010] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:50.132371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4111b6-a76b-4908-8ccb-b87d1282b001 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:50.132659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4111b6-a76b-4908-8ccb-b87d1282b001 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:50.132934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4111b6-a76b-4908-8ccb-b87d1282b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:50.151744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cf4111b6-a76b-4908-8ccb-b87d1282b001 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:50.153018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cf4111b6-a76b-4908-8ccb-b87d1282b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:50.167268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd4bfb-9b4a-4632-9081-2b182bc1ae20 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:50.206730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a06ea2-dfa5-4087-b6e5-3539238d56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:50.207374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06ea2-dfa5-4087-b6e5-3539238d56a2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:50.207689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06ea2-dfa5-4087-b6e5-3539238d56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:50.207922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06ea2-dfa5-4087-b6e5-3539238d56a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:50.209106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a06ea2-dfa5-4087-b6e5-3539238d56a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:50.210591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a06ea2-dfa5-4087-b6e5-3539238d56a2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:50.212229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 508/1011] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:50.217905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a06ea2-dfa5-4087-b6e5-3539238d56a2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:50.242930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 504/1012] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:50.363234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:50.380569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a06ea2-dfa5-4087-b6e5-3539238d56a2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:50.428368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25323a-a1cf-4baa-aca5-2239ef742f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:50.429342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25323a-a1cf-4baa-aca5-2239ef742f31 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:50.429958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25323a-a1cf-4baa-aca5-2239ef742f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:50.430432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25323a-a1cf-4baa-aca5-2239ef742f31 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:50.431918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25323a-a1cf-4baa-aca5-2239ef742f31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:50.434641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25323a-a1cf-4baa-aca5-2239ef742f31 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:50.485587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 509/1013] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:09:50 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:09:50.552409 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4111b6-a76b-4908-8ccb-b87d1282b001 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:50.614164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:50.680589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4111b6-a76b-4908-8ccb-b87d1282b001 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:50.720502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:50.721135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:50.721416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:50.721783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:50.722381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:50.723848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:50.733268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:50.734433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:50.735298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 505/1014] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:50.742839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25323a-a1cf-4baa-aca5-2239ef742f31 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:50.877187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25323a-a1cf-4baa-aca5-2239ef742f31 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:50.915759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:50.915759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:50.915759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:50.916205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:50.916730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:50.917027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:50.918426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:50.929605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 510/1015] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:50.930850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:51.069553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a09774-2cdb-4ce7-a917-62209ffeb106 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:51.083758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:51.120144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80a1b7-6425-4b25-9aa3-4363f22e43ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:51.120772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80a1b7-6425-4b25-9aa3-4363f22e43ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:51.121057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80a1b7-6425-4b25-9aa3-4363f22e43ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:51.121336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80a1b7-6425-4b25-9aa3-4363f22e43ab None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:51.122049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80a1b7-6425-4b25-9aa3-4363f22e43ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:51.122345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80a1b7-6425-4b25-9aa3-4363f22e43ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:51.123743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80a1b7-6425-4b25-9aa3-4363f22e43ab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:51.132188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 506/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Oct 6 12:09:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:51.137706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:51.142420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:51.269207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8d16-8911-4fa0-96ed-724660058d3d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:51.310413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c0cef-acc7-47a7-9c27-b2a145772caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:51.311957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c0cef-acc7-47a7-9c27-b2a145772caa None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:51.311957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c0cef-acc7-47a7-9c27-b2a145772caa None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:51.311957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c0cef-acc7-47a7-9c27-b2a145772caa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:51.312519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c0cef-acc7-47a7-9c27-b2a145772caa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:51.313927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c0cef-acc7-47a7-9c27-b2a145772caa None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:51.345568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 511/1017] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:09:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:09:51.666992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09c30f-c5de-4fda-a351-bc1ff982900d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:51.667391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09c30f-c5de-4fda-a351-bc1ff982900d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:51.667572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09c30f-c5de-4fda-a351-bc1ff982900d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:51.669083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 507/1018] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:51.674652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d10a4-2803-4c87-86e7-647c325696f2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:51.674941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d10a4-2803-4c87-86e7-647c325696f2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:51.675213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d10a4-2803-4c87-86e7-647c325696f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:51.693763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-677d10a4-2803-4c87-86e7-647c325696f2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:51.694962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-677d10a4-2803-4c87-86e7-647c325696f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:51.755575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:51.776005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 512/1019] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:51 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:52.055832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09c30f-c5de-4fda-a351-bc1ff982900d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:52.174133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09c30f-c5de-4fda-a351-bc1ff982900d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:52.210840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84894a4-5aa7-4fb5-bb90-d84fbd7ae106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:52.211458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84894a4-5aa7-4fb5-bb90-d84fbd7ae106 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:52.211744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84894a4-5aa7-4fb5-bb90-d84fbd7ae106 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:52.212019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84894a4-5aa7-4fb5-bb90-d84fbd7ae106 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:52.212685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84894a4-5aa7-4fb5-bb90-d84fbd7ae106 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:52.214142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84894a4-5aa7-4fb5-bb90-d84fbd7ae106 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:52.231305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 508/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:09:52 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:52.908305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada805f9-cdcc-4d44-bb61-fd9dc7339b12 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:52.908834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada805f9-cdcc-4d44-bb61-fd9dc7339b12 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:52.908834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada805f9-cdcc-4d44-bb61-fd9dc7339b12 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:52.910389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 513/1021] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:52.915690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc89a3-4725-4197-8d0f-2f1651e80af1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:52.915992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc89a3-4725-4197-8d0f-2f1651e80af1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:52.916278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc89a3-4725-4197-8d0f-2f1651e80af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:52.935266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c8cc89a3-4725-4197-8d0f-2f1651e80af1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:52.937082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c8cc89a3-4725-4197-8d0f-2f1651e80af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:52.969949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:53.025566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 509/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:53.299003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada805f9-cdcc-4d44-bb61-fd9dc7339b12 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:53.409142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada805f9-cdcc-4d44-bb61-fd9dc7339b12 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:53.446064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c0bfe-1574-4304-ba86-93fe9bc5c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:53.446703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0bfe-1574-4304-ba86-93fe9bc5c320 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:53.446990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0bfe-1574-4304-ba86-93fe9bc5c320 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:53.447261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0bfe-1574-4304-ba86-93fe9bc5c320 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:53.448392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c0bfe-1574-4304-ba86-93fe9bc5c320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:53.449894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c0bfe-1574-4304-ba86-93fe9bc5c320 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:53.453576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 514/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:53.458023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc89a3-4725-4197-8d0f-2f1651e80af1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:53.559562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc89a3-4725-4197-8d0f-2f1651e80af1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:53.608226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796fb36-bbdb-4537-9a8c-8a57a174a06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:53.609174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796fb36-bbdb-4537-9a8c-8a57a174a06c None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:53.609653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796fb36-bbdb-4537-9a8c-8a57a174a06c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:53.609933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796fb36-bbdb-4537-9a8c-8a57a174a06c None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:53.610610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796fb36-bbdb-4537-9a8c-8a57a174a06c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:53.612077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796fb36-bbdb-4537-9a8c-8a57a174a06c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:53.641615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 510/1024] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:09:53 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:09:53.707243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3d14d-0920-4833-844e-6e879cadfd12 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:53.707550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3d14d-0920-4833-844e-6e879cadfd12 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:53.707797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3d14d-0920-4833-844e-6e879cadfd12 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:53.709168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 515/1025] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:53.715049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb5c5-b1f0-4b21-94dc-894187c31055 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:53.715470 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb5c5-b1f0-4b21-94dc-894187c31055 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:53.715626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb5c5-b1f0-4b21-94dc-894187c31055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:53.735394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-655fb5c5-b1f0-4b21-94dc-894187c31055 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:53.736633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-655fb5c5-b1f0-4b21-94dc-894187c31055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:53.753357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:53.829641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 511/1026] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:54.106899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3d14d-0920-4833-844e-6e879cadfd12 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:54.174289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:54.224296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3d14d-0920-4833-844e-6e879cadfd12 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:54.259404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11fbb3-78bf-44e7-bf62-642cf20d8214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:54.260038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11fbb3-78bf-44e7-bf62-642cf20d8214 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:54.260322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11fbb3-78bf-44e7-bf62-642cf20d8214 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:54.260601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11fbb3-78bf-44e7-bf62-642cf20d8214 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:54.271602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11fbb3-78bf-44e7-bf62-642cf20d8214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fc11fbb3-78bf-44e7-bf62-642cf20d8214 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:54.276820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:54.278001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:54.278837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 516/1027] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Oct 6 12:09:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:54.286347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb5c5-b1f0-4b21-94dc-894187c31055 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:54.392157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb5c5-b1f0-4b21-94dc-894187c31055 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:54.427795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71b48-3b3e-41b3-9b2d-3358e55ba60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:54.428459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71b48-3b3e-41b3-9b2d-3358e55ba60a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:54.428694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71b48-3b3e-41b3-9b2d-3358e55ba60a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:54.428968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71b48-3b3e-41b3-9b2d-3358e55ba60a None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:54.429686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71b48-3b3e-41b3-9b2d-3358e55ba60a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:54.429997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71b48-3b3e-41b3-9b2d-3358e55ba60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:54.431383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71b48-3b3e-41b3-9b2d-3358e55ba60a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:54.445426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 512/1028] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Oct 6 12:09:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:54.447102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11fbb3-78bf-44e7-bf62-642cf20d8214 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:54.479331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d5d7-2977-40cc-adde-a9e1e5f90a97 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:54.479863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d5d7-2977-40cc-adde-a9e1e5f90a97 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:54.479863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d5d7-2977-40cc-adde-a9e1e5f90a97 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:54.481401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 513/1029] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:54.487393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbfb11-3429-48f6-b2a2-cfabc63fca32 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:54.487710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbfb11-3429-48f6-b2a2-cfabc63fca32 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:54.487956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbfb11-3429-48f6-b2a2-cfabc63fca32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:54.507034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d3fbfb11-3429-48f6-b2a2-cfabc63fca32 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:54.508237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d3fbfb11-3429-48f6-b2a2-cfabc63fca32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:54.511323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:54.587491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11fbb3-78bf-44e7-bf62-642cf20d8214 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:54.597288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 514/1030] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:54.603965 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:54.645559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:54.646466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:54.646905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:54.647347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:54.659781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:54.661252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:54.678600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:54.679728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:54.680638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:54.680638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:54.680638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:54.680638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 517/1031] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:54.688545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbfb11-3429-48f6-b2a2-cfabc63fca32 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:54.785231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbfb11-3429-48f6-b2a2-cfabc63fca32 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:54.820867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:54.821478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:54.821832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:54.822109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:54.822759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:54.823060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:54.824433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:54.833336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:54.841749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 515/1032] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:54.844310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:54.889194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:54.957678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54f5fa-ac18-4298-90c9-3befc0eec5ab None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:54.996745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:54.997495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:54.997822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:54.998100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.007308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.008753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.011393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1e8ba-7e1c-4a9c-b58a-d64c8600921c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:09:55.020950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:55.024319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:55.025283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 518/1033] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:09:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:55.029456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:55.056608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.057590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.057886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.058163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] PATH_INFO: `/v3/services/image` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.058751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.059491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:55.061442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:55.072352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:55.073418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:55.079176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 516/1034] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Oct 6 12:09:54 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:55.080160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:55.151374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:55.151583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d3108-82d3-45df-ae59-09c137973f1d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.193741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.194355 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.194462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603651af-d61d-42f0-9249-3214e2fda57e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.194659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.194897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.195614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:55.195918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.197348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.216638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 519/1035] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:55.224128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:55.232359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.234261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.234722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.235159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.236097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] RBAC: Adding query filter params (name=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:55.236411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.237858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.248250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 517/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:55.249154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:55.320247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:55.337275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab547-b488-4cd9-94e3-129c4ee8f3d0 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.375915 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca230-3e81-4510-b08e-9c5621a08222 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.381587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95beaa-880a-4918-8761-d7f9ac3920f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.382212 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95beaa-880a-4918-8761-d7f9ac3920f1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.382491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95beaa-880a-4918-8761-d7f9ac3920f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.382761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95beaa-880a-4918-8761-d7f9ac3920f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.409255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:55.418785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.419479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.419675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.419923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.420844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:55.421111 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.423194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.428874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 518/1037] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:55.434804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:55.467462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95beaa-880a-4918-8761-d7f9ac3920f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.469553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95beaa-880a-4918-8761-d7f9ac3920f1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.559866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c424c91-984e-4bb9-84ce-5bbcc8330da5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.565522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:55.584811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 520/1038] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 12:09:55.591153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95beaa-880a-4918-8761-d7f9ac3920f1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:55.606455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.607186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.607536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.607879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.609369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] RBAC: Adding query filter params (interface=public, service_id=c3329f95fa854965b05452bf584081fe, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:55.609899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.611759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.618833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 519/1039] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/endpoints?service_id=c3329f95fa854965b05452bf584081fe&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:55.627868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:55.705945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:55.726260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95beaa-880a-4918-8761-d7f9ac3920f1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.756974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c88d71-ed84-405a-98ce-18ed22ff6242 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.761713 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.762309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.762763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.762763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.776542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.777989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:55.797257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:55.798513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:55.799432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:55.799432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:55.799432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:55.799432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 521/1040] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:09:55.801031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429f4e-7c2c-4373-8355-6861595526d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.801859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429f4e-7c2c-4373-8355-6861595526d0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.802276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429f4e-7c2c-4373-8355-6861595526d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.802682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429f4e-7c2c-4373-8355-6861595526d0 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.803714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429f4e-7c2c-4373-8355-6861595526d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.804388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:55.805140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429f4e-7c2c-4373-8355-6861595526d0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.812591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 520/1041] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/services => generated 1957 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:09:55.847272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:55.927052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641441-908c-4931-b87c-d9ce5eb04423 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:55.964331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744e0a1-a8fc-475c-ab52-2a0a2d411166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:55.965050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744e0a1-a8fc-475c-ab52-2a0a2d411166 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:55.965395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744e0a1-a8fc-475c-ab52-2a0a2d411166 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:55.965764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744e0a1-a8fc-475c-ab52-2a0a2d411166 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:55.966495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744e0a1-a8fc-475c-ab52-2a0a2d411166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:55.966870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744e0a1-a8fc-475c-ab52-2a0a2d411166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:55.968971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744e0a1-a8fc-475c-ab52-2a0a2d411166 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:55.987565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 522/1042] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:55.989359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429f4e-7c2c-4373-8355-6861595526d0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:56.000618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba4965-debd-4496-b6f8-f4accfa27b22 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:56.000902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba4965-debd-4496-b6f8-f4accfa27b22 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:56.001276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba4965-debd-4496-b6f8-f4accfa27b22 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:56.002821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 523/1043] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:56.008341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c517d-ec56-4c5d-b026-195277948b23 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:56.008624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c517d-ec56-4c5d-b026-195277948b23 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:56.008897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c517d-ec56-4c5d-b026-195277948b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:56.028512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-bb2c517d-ec56-4c5d-b026-195277948b23 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:56.029766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bb2c517d-ec56-4c5d-b026-195277948b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:56.110494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429f4e-7c2c-4373-8355-6861595526d0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:56.111724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 524/1044] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:56.136326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:56.152221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:56.152938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:56.153147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:56.153428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:56.162654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:56.164127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:09:56.176298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:56.177262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:56.183048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 521/1045] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:09:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:56.185359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c517d-ec56-4c5d-b026-195277948b23 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:56.215553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:56.294388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c517d-ec56-4c5d-b026-195277948b23 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:56.339376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:56.339997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:56.340277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:56.340546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:56.341243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:56.341595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:56.343920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:56.361626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 525/1046] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:09:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:56.363090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:56.383380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:56.479454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9bc9f-5ac3-43da-b317-8beb3d628b49 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:56.480417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:56.507317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff279b1b-a323-4e24-9577-d9a8a7fc6628 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:56.522865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:56.523486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:56.524027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:56.524308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:56.525053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] RBAC: Adding query filter params (role.id=2b4d2133304046c4a33aae2ed1758aaa, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=1bd257708357455d99990b01af81e5b0) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:56.525366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:56.526839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:56.541566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 522/1047] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:56 2022] GET /identity/v3/role_assignments?user.id=1bd257708357455d99990b01af81e5b0&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=2b4d2133304046c4a33aae2ed1758aaa => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:56.556118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68fee-54bf-46ed-8cfb-704d7348ad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:56.556683 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68fee-54bf-46ed-8cfb-704d7348ad81 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:56.556959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68fee-54bf-46ed-8cfb-704d7348ad81 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:56.557227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68fee-54bf-46ed-8cfb-704d7348ad81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:56.571794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d68fee-54bf-46ed-8cfb-704d7348ad81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-98d68fee-54bf-46ed-8cfb-704d7348ad81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:56.576770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:56.578503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:56.579361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 526/1048] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:09:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:56.584691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:56.637221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:56.702085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d744d4f-4406-4fee-a898-dbe592260b91 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:56.760414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:56.761434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:56.761967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:56.762456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:56.763720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:56.764665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:56.767869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:56.788428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 523/1049] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:09:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:56.789853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68fee-54bf-46ed-8cfb-704d7348ad81 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:56.904279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68fee-54bf-46ed-8cfb-704d7348ad81 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:56.939855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f0448-96e6-474b-bbef-9282a04c1ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:56.940490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f0448-96e6-474b-bbef-9282a04c1ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:56.940766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f0448-96e6-474b-bbef-9282a04c1ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:56.941034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f0448-96e6-474b-bbef-9282a04c1ba2 None admin] PATH_INFO: `/v3/users/d97b004a6ae245a7ba4a331bf8f6dfee` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:56.955408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f0448-96e6-474b-bbef-9282a04c1ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=d97b004a6ae245a7ba4a331bf8f6dfee)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:56.956846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f0448-96e6-474b-bbef-9282a04c1ba2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:56.958731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 527/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:09:56 2022] GET /identity/v3/users/d97b004a6ae245a7ba4a331bf8f6dfee => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:56.964157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:57.091823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7f35-1c6e-4698-a7b5-e30de97a5532 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:57.104638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:57.140501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1473db-9b01-4ef2-a684-81762df334fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:57.141125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1473db-9b01-4ef2-a684-81762df334fe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:57.141407 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1473db-9b01-4ef2-a684-81762df334fe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:57.141723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1473db-9b01-4ef2-a684-81762df334fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:57.214612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1473db-9b01-4ef2-a684-81762df334fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:57.215972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1473db-9b01-4ef2-a684-81762df334fe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:57.320593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 524/1051] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:09:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:09:57.326293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f0448-96e6-474b-bbef-9282a04c1ba2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:57.331391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:57.430720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f0448-96e6-474b-bbef-9282a04c1ba2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:57.466935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7f899-c810-44a6-a2fa-b3e5311aed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:57.468051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f899-c810-44a6-a2fa-b3e5311aed2e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:57.468435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f899-c810-44a6-a2fa-b3e5311aed2e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:57.469005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f899-c810-44a6-a2fa-b3e5311aed2e None admin] PATH_INFO: `/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:57.469838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7f899-c810-44a6-a2fa-b3e5311aed2e None admin] RBAC: Authorizing `identity:get_project(project_id=5d17fa9d5e034667813e76ef8a39bc7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:57.471269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7f899-c810-44a6-a2fa-b3e5311aed2e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:57.473113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 528/1052] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:09:57 2022] GET /identity/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:57.478943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1473db-9b01-4ef2-a684-81762df334fe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:57.487217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:57.579485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1473db-9b01-4ef2-a684-81762df334fe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:57.619600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5d5d-a7a3-49f4-a97c-a0194b7fceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:57.620436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5d5d-a7a3-49f4-a97c-a0194b7fceb5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:57.620660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5d5d-a7a3-49f4-a97c-a0194b7fceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:57.620979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5d5d-a7a3-49f4-a97c-a0194b7fceb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:57.622326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5d5d-a7a3-49f4-a97c-a0194b7fceb5 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=5d17fa9d5e034667813e76ef8a39bc7d, user.id=d97b004a6ae245a7ba4a331bf8f6dfee) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:57.622857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5d5d-a7a3-49f4-a97c-a0194b7fceb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:57.624864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5d5d-a7a3-49f4-a97c-a0194b7fceb5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:57.631006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 525/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:09:57 2022] GET /identity/v3/role_assignments?user.id=d97b004a6ae245a7ba4a331bf8f6dfee&scope.project.id=5d17fa9d5e034667813e76ef8a39bc7d&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:58.082347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259fb6b-b3d0-48c9-a0f8-ff49799851aa None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:58.082752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259fb6b-b3d0-48c9-a0f8-ff49799851aa None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:58.082936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259fb6b-b3d0-48c9-a0f8-ff49799851aa None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:58.084270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 529/1054] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:58.089520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc28b1-376c-4659-ba4a-d73821de21bb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:58.089849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc28b1-376c-4659-ba4a-d73821de21bb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:58.090129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc28b1-376c-4659-ba4a-d73821de21bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:58.113505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-78cc28b1-376c-4659-ba4a-d73821de21bb None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:58.114751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-78cc28b1-376c-4659-ba4a-d73821de21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:58.182582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:58.193577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 526/1055] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:58.527221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259fb6b-b3d0-48c9-a0f8-ff49799851aa None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:58.612511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:58.646427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259fb6b-b3d0-48c9-a0f8-ff49799851aa None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:58.689188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b0b2d-47a1-464a-bd15-e17a20686ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:58.689869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b0b2d-47a1-464a-bd15-e17a20686ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:58.690207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b0b2d-47a1-464a-bd15-e17a20686ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:58.690697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b0b2d-47a1-464a-bd15-e17a20686ae5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:58.691524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b0b2d-47a1-464a-bd15-e17a20686ae5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:58.693716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b0b2d-47a1-464a-bd15-e17a20686ae5 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-629b0b2d-47a1-464a-bd15-e17a20686ae5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:58.708342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:58.709407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 06 12:09:58.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:09:58.713890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 530/1056] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Oct 6 12:09:58 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:58.719280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc28b1-376c-4659-ba4a-d73821de21bb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:58.780950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85262-7e9e-42e6-aa1a-06ff6ceb8a69 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:58.781279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85262-7e9e-42e6-aa1a-06ff6ceb8a69 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:58.781661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85262-7e9e-42e6-aa1a-06ff6ceb8a69 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:58.784086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 531/1057] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:09:58.789630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51858b22-36e0-4410-a361-b87a5ad94bff None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:58.789918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51858b22-36e0-4410-a361-b87a5ad94bff None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:58.790199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51858b22-36e0-4410-a361-b87a5ad94bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:58.810593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-51858b22-36e0-4410-a361-b87a5ad94bff None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:58.812540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-51858b22-36e0-4410-a361-b87a5ad94bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:58.840493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc28b1-376c-4659-ba4a-d73821de21bb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:58.882416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:58.882839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:58.883129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:58.883714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:58.884372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] RBAC: Adding query filter params (name=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:58.884689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:58.886570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:58.897528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 527/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:58.898353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:58.901740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 532/1059] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:09:58.964288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:59.004839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d57c98-c135-416c-94e8-17c03d1f4e06 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:59.051229 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:59.051770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:59.052058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:59.052336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:59.052984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] RBAC: Adding query filter params (type=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:59.053295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:59.056549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:59.062818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 528/1060] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:59.068395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51858b22-36e0-4410-a361-b87a5ad94bff None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:59.154184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:59.171968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:59.195886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51858b22-36e0-4410-a361-b87a5ad94bff None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:59.232148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0851b-fc77-42bf-82d3-0e5e8c351019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:59.232765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0851b-fc77-42bf-82d3-0e5e8c351019 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:59.233749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0851b-fc77-42bf-82d3-0e5e8c351019 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:59.234026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0851b-fc77-42bf-82d3-0e5e8c351019 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:59.235179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0851b-fc77-42bf-82d3-0e5e8c351019 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:59.237011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0851b-fc77-42bf-82d3-0e5e8c351019 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:59.263149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 533/1061] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:09:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:09:59.300491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aded0f-0f28-4560-b1d7-2925adcece3e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:59.331863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:59.349243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6841d-56b9-4dfc-85c4-f8eb9ffb5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:59.349924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6841d-56b9-4dfc-85c4-f8eb9ffb5120 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:59.350209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6841d-56b9-4dfc-85c4-f8eb9ffb5120 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:59.350484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6841d-56b9-4dfc-85c4-f8eb9ffb5120 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:59.364029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6841d-56b9-4dfc-85c4-f8eb9ffb5120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2ae6841d-56b9-4dfc-85c4-f8eb9ffb5120 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:09:59.369128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:59.370384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:09:59.371265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:59.374454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 529/1062] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Oct 6 12:09:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:59.377212 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0851b-fc77-42bf-82d3-0e5e8c351019 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:59.504063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0851b-fc77-42bf-82d3-0e5e8c351019 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:59.527665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:59.542157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:59.542772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:59.543049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:59.543317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:59.543979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:59.544280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:59.546315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:59.559618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 534/1063] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Oct 6 12:09:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:09:59.560940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6841d-56b9-4dfc-85c4-f8eb9ffb5120 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:59.668992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6841d-56b9-4dfc-85c4-f8eb9ffb5120 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:59.705158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1c409-984a-436c-b7fe-ae1a193823c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:59.705820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1c409-984a-436c-b7fe-ae1a193823c9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:59.706108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1c409-984a-436c-b7fe-ae1a193823c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:59.706382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1c409-984a-436c-b7fe-ae1a193823c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:59.716528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1c409-984a-436c-b7fe-ae1a193823c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:59.718608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1c409-984a-436c-b7fe-ae1a193823c9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d4a1c409-984a-436c-b7fe-ae1a193823c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:09:59.735532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:09:59.737011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:09:59.738385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:09:59.738385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:09:59.738385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:09:59.741779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 530/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:09:59.742854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:59.852462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5640a-be0e-46c8-91c8-0e4e13cb01b4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:59.852793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5640a-be0e-46c8-91c8-0e4e13cb01b4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:59.852919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db738ba-9652-4b63-b78a-1cc4ab0f0057 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:09:59.853084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5640a-be0e-46c8-91c8-0e4e13cb01b4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:59.854493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 531/1065] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:09:59.860807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba1b4-ad8d-4cfa-95a2-da3850d28856 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:59.861100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba1b4-ad8d-4cfa-95a2-da3850d28856 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:59.861416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba1b4-ad8d-4cfa-95a2-da3850d28856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:59.882488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9bbba1b4-ad8d-4cfa-95a2-da3850d28856 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:09:59.883757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9bbba1b4-ad8d-4cfa-95a2-da3850d28856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:09:59.892085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:09:59.892699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:09:59.892976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:09:59.893240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:09:59.893902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:09:59.894203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:09:59.895555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:09:59.917957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 535/1066] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:09:59.923422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:09:59.924191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:09:59.966334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 532/1067] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:09:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:09:59.972054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:00.029298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bb18b-dbb8-4fe5-b301-b7a747663d7d None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.064578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.065212 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.065489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.065800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.074402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:00.075928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:10:00.088117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:00.089074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:10:00.090589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:00.094607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 536/1068] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:09:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:00.095613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbba1b4-ad8d-4cfa-95a2-da3850d28856 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.219688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbba1b4-ad8d-4cfa-95a2-da3850d28856 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.240073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.255242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.255864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.256151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.256428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.257171 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:00.257480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:00.258941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:00.278081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 533/1069] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:00.283728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.312223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:00.358781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdcba5-5526-4a29-ba46-9c1bff56fc0a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.361325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:00.398739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f930f65-f0d4-441e-9f72-e396c49aa0fe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.399285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b93bb8-d62f-4a03-bf33-0667cb8f2d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.399915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b93bb8-d62f-4a03-bf33-0667cb8f2d8e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.400298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b93bb8-d62f-4a03-bf33-0667cb8f2d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.400569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b93bb8-d62f-4a03-bf33-0667cb8f2d8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.415248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b93bb8-d62f-4a03-bf33-0667cb8f2d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-34b93bb8-d62f-4a03-bf33-0667cb8f2d8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:00.421176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:00.422446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:00.423317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 537/1070] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:00.428847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b93bb8-d62f-4a03-bf33-0667cb8f2d8e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.444898 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.445761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.446049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.446736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.458191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:00.459655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:10:00.476494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:00.477557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:10:00.478478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:10:00.478478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:10:00.478478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:00.478478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 534/1071] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:00.483972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.543296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b93bb8-d62f-4a03-bf33-0667cb8f2d8e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.569235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:00.594344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf63d-a552-4f9e-b748-968d3b1a5ae9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.594550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.594963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.595239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.595514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.596167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:00.596465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:00.597878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:00.606746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 538/1072] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:00.613378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.634059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.634692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.634975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.635247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.635913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:00.636218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:00.637648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:00.645949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:00.651735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 535/1073] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:00.657944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.731751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774fe0b-08b3-4644-acc8-394b35c82a33 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.764577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31396308-4f4d-4c9f-98c7-49d51b6baf03 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.771080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2a10-b244-48b9-960e-38b62e02aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.771719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2a10-b244-48b9-960e-38b62e02aefd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.771994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2a10-b244-48b9-960e-38b62e02aefd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.772262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2a10-b244-48b9-960e-38b62e02aefd None admin] PATH_INFO: `/v3/users/d97b004a6ae245a7ba4a331bf8f6dfee` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.773392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d2a10-b244-48b9-960e-38b62e02aefd None admin] RBAC: Authorizing `identity:get_user(user_id=d97b004a6ae245a7ba4a331bf8f6dfee)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:00.775097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d2a10-b244-48b9-960e-38b62e02aefd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:00.776828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 539/1074] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/users/d97b004a6ae245a7ba4a331bf8f6dfee => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:00.782491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2a10-b244-48b9-960e-38b62e02aefd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.803988 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.804632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.804918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.805198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.808553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:00.814484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:00.816948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:10:00.829494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:00.830464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:00.831366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 536/1075] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:00.836434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.894365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:00.901779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2a10-b244-48b9-960e-38b62e02aefd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:00.939224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d82b-aa01-4020-b399-b8e09557f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:00.939875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d82b-aa01-4020-b399-b8e09557f899 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:00.940157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d82b-aa01-4020-b399-b8e09557f899 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:00.940434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d82b-aa01-4020-b399-b8e09557f899 None admin] PATH_INFO: `/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:00.941673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0d82b-aa01-4020-b399-b8e09557f899 None admin] RBAC: Authorizing `identity:get_project(project_id=5d17fa9d5e034667813e76ef8a39bc7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:00.943127 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0d82b-aa01-4020-b399-b8e09557f899 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:00.945145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 540/1076] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:00.951308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d82b-aa01-4020-b399-b8e09557f899 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:00.970631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3aa005-eb9f-4afd-b79f-91661a19313e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:01.020038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:01.020675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:01.020965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:01.021245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:01.022001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:01.022312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:01.024004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:01.037949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 537/1077] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:01.044055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:01.067876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d82b-aa01-4020-b399-b8e09557f899 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:01.111481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66ef86-b0de-46aa-a992-e830c1588872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:01.112153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ef86-b0de-46aa-a992-e830c1588872 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:01.112446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ef86-b0de-46aa-a992-e830c1588872 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:01.112701 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ef86-b0de-46aa-a992-e830c1588872 None admin] PATH_INFO: `/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d/users/d97b004a6ae245a7ba4a331bf8f6dfee/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:01.114231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:01.114693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66ef86-b0de-46aa-a992-e830c1588872 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d17fa9d5e034667813e76ef8a39bc7d, user_id=d97b004a6ae245a7ba4a331bf8f6dfee, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:01.116229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66ef86-b0de-46aa-a992-e830c1588872 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:01.136436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 541/1078] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:10:00 2022] PUT /identity/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d/users/d97b004a6ae245a7ba4a331bf8f6dfee/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:10:01.178539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f395619-c07d-4839-ac32-24e591c74ad7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:01.226099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8c66-c98e-4b72-bce4-f78e628379f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:01.227197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8c66-c98e-4b72-bce4-f78e628379f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:01.227687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8c66-c98e-4b72-bce4-f78e628379f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:01.228186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8c66-c98e-4b72-bce4-f78e628379f3 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/1bd257708357455d99990b01af81e5b0/roles/2b4d2133304046c4a33aae2ed1758aaa` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:01.235015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8c66-c98e-4b72-bce4-f78e628379f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=1bd257708357455d99990b01af81e5b0, role_id=2b4d2133304046c4a33aae2ed1758aaa)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:01.236916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8c66-c98e-4b72-bce4-f78e628379f3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:01.254283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 538/1079] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:10:01 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/1bd257708357455d99990b01af81e5b0/roles/2b4d2133304046c4a33aae2ed1758aaa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:10:01.536028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14be029-0cdd-4349-a32b-00a7b0d3091b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:01.536596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14be029-0cdd-4349-a32b-00a7b0d3091b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:01.537059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14be029-0cdd-4349-a32b-00a7b0d3091b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:01.539566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 542/1080] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:01.546359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9a724-622f-461e-b14a-064ee1567d41 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:01.546738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9a724-622f-461e-b14a-064ee1567d41 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:01.547052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9a724-622f-461e-b14a-064ee1567d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:01.567965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9ae9a724-622f-461e-b14a-064ee1567d41 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:01.569185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9ae9a724-622f-461e-b14a-064ee1567d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:01.650820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 539/1081] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:01.941516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14be029-0cdd-4349-a32b-00a7b0d3091b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:01.971176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:02.055819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14be029-0cdd-4349-a32b-00a7b0d3091b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:02.111478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe26425-0b4d-4ef2-a192-8a08b9070b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:02.112086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe26425-0b4d-4ef2-a192-8a08b9070b03 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:02.112361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe26425-0b4d-4ef2-a192-8a08b9070b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:02.112628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe26425-0b4d-4ef2-a192-8a08b9070b03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:02.197174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe26425-0b4d-4ef2-a192-8a08b9070b03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:02.198588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe26425-0b4d-4ef2-a192-8a08b9070b03 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:02.226221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:02.317571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 543/1082] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:10:02.319294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9a724-622f-461e-b14a-064ee1567d41 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:02.366865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:02.430173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9a724-622f-461e-b14a-064ee1567d41 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:02.471007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b536f-2cfc-4dc4-a130-de65b135cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:02.472089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b536f-2cfc-4dc4-a130-de65b135cb76 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:02.472588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b536f-2cfc-4dc4-a130-de65b135cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:02.473058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b536f-2cfc-4dc4-a130-de65b135cb76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:02.484656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b536f-2cfc-4dc4-a130-de65b135cb76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:02.486425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b536f-2cfc-4dc4-a130-de65b135cb76 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f96b536f-2cfc-4dc4-a130-de65b135cb76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:10:02.501678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:02.502699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:10:02.503620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:10:02.503620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:10:02.503620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:02.504114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 540/1083] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:02.510224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe26425-0b4d-4ef2-a192-8a08b9070b03 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:02.619195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe26425-0b4d-4ef2-a192-8a08b9070b03 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:02.648286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:02.668788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4557b-d009-412d-a472-f14d84302a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:02.669404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4557b-d009-412d-a472-f14d84302a97 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:02.669707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4557b-d009-412d-a472-f14d84302a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:02.669975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4557b-d009-412d-a472-f14d84302a97 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:02.670794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4557b-d009-412d-a472-f14d84302a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:02.671005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4557b-d009-412d-a472-f14d84302a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:02.672376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4557b-d009-412d-a472-f14d84302a97 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:02.689789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 544/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:03.374962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be02c19-3c36-4893-ac7e-5162c2954c6a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:03.375507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be02c19-3c36-4893-ac7e-5162c2954c6a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:03.375596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be02c19-3c36-4893-ac7e-5162c2954c6a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:03.376951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 541/1085] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:03.382993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688835f-9d6f-403f-bf8d-962b829dede8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:03.383505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688835f-9d6f-403f-bf8d-962b829dede8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:03.383505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688835f-9d6f-403f-bf8d-962b829dede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:03.402088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d688835f-9d6f-403f-bf8d-962b829dede8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:03.403265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d688835f-9d6f-403f-bf8d-962b829dede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:03.470587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 545/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:03.480131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e92f-1695-47f3-85bf-86406a241821 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:03.480427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e92f-1695-47f3-85bf-86406a241821 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:03.480710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e92f-1695-47f3-85bf-86406a241821 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:03.482065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 542/1087] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:03.488759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622eb1-9869-406f-832e-d511877a077a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:03.489040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622eb1-9869-406f-832e-d511877a077a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:03.489306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622eb1-9869-406f-832e-d511877a077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:03.507897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-45622eb1-9869-406f-832e-d511877a077a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:03.509068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-45622eb1-9869-406f-832e-d511877a077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:03.577301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 546/1088] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:03.750897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e92f-1695-47f3-85bf-86406a241821 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:03.847856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:03.849711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622eb1-9869-406f-832e-d511877a077a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:03.853478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e92f-1695-47f3-85bf-86406a241821 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:03.886408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f49df-d1a8-4f57-9ae3-953b1097e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:03.887037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f49df-d1a8-4f57-9ae3-953b1097e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:03.887326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f49df-d1a8-4f57-9ae3-953b1097e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:03.887599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f49df-d1a8-4f57-9ae3-953b1097e5b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:03.896849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:03.900303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f49df-d1a8-4f57-9ae3-953b1097e5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3d3f49df-d1a8-4f57-9ae3-953b1097e5b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:03.905594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:03.906613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:03.907460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 543/1089] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:10:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:10:03.912674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f49df-d1a8-4f57-9ae3-953b1097e5b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:03.951787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622eb1-9869-406f-832e-d511877a077a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:03.986461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf0a7-f2d7-4594-ac59-e07bf0126e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:03.987093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf0a7-f2d7-4594-ac59-e07bf0126e98 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:03.987368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf0a7-f2d7-4594-ac59-e07bf0126e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:03.987637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf0a7-f2d7-4594-ac59-e07bf0126e98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:03.997724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bf0a7-f2d7-4594-ac59-e07bf0126e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-815bf0a7-f2d7-4594-ac59-e07bf0126e98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:04.003054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:04.004113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:04.005018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 547/1090] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Oct 6 12:10:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:04.010084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf0a7-f2d7-4594-ac59-e07bf0126e98 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.011115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f49df-d1a8-4f57-9ae3-953b1097e5b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.046841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.047447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.047729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.048002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.048669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:04.048973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.050359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.058885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 544/1091] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:10:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:04.065677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.092349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:04.117154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf0a7-f2d7-4594-ac59-e07bf0126e98 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.118738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:04.156582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.157190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.157468 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.157774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.158432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:04.158735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.160104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.167907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 548/1092] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:04.171963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fece93-54db-43e4-a4fe-19aede1d43fe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.173995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.206705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca78a54-ed58-438b-9876-dacc1e20a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.207332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78a54-ed58-438b-9876-dacc1e20a020 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.207782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78a54-ed58-438b-9876-dacc1e20a020 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.207884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78a54-ed58-438b-9876-dacc1e20a020 None admin] PATH_INFO: `/v3/users/d97b004a6ae245a7ba4a331bf8f6dfee` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.209019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca78a54-ed58-438b-9876-dacc1e20a020 None admin] RBAC: Authorizing `identity:get_user(user_id=d97b004a6ae245a7ba4a331bf8f6dfee)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.210499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca78a54-ed58-438b-9876-dacc1e20a020 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.212574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 545/1093] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/users/d97b004a6ae245a7ba4a331bf8f6dfee => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:04.219228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca78a54-ed58-438b-9876-dacc1e20a020 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.280825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c496-9ff3-42d6-8b04-41b2aa723ceb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.306692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:04.319159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca78a54-ed58-438b-9876-dacc1e20a020 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.323541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.324177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.324453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.324725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.335358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.336790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:10:04.351191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:04.352185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:10:04.353130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:10:04.353130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:10:04.353130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:04.353130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 549/1094] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:10:04.358344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebf319-eba2-415f-ad6b-b8beb0a37582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.358647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.358955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebf319-eba2-415f-ad6b-b8beb0a37582 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.359239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebf319-eba2-415f-ad6b-b8beb0a37582 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.359509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebf319-eba2-415f-ad6b-b8beb0a37582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.376167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:04.432130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebf319-eba2-415f-ad6b-b8beb0a37582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.434517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebf319-eba2-415f-ad6b-b8beb0a37582 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.465400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20d6e-79fd-44c8-8bce-6348661e19aa None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.502291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.502910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.503185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.503495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.504100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:04.504397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.505799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.519930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 550/1095] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:04.526058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.540198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:04.555404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 546/1096] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 12:10:04.561619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebf319-eba2-415f-ad6b-b8beb0a37582 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.609710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:04.648895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a07c49-f351-4314-a9cb-1e1e70d93225 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.686250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.686889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.687368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.687643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.693447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebf319-eba2-415f-ad6b-b8beb0a37582 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.700094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.702388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:10:04.714411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:04.715462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:04.718281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 551/1097] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:04.721951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.731437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84450c-88a7-4203-aa4e-513f5eafd536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.732070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84450c-88a7-4203-aa4e-513f5eafd536 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.732429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84450c-88a7-4203-aa4e-513f5eafd536 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.732722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84450c-88a7-4203-aa4e-513f5eafd536 None admin] PATH_INFO: `/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.734056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84450c-88a7-4203-aa4e-513f5eafd536 None admin] RBAC: Authorizing `identity:get_project(project_id=5d17fa9d5e034667813e76ef8a39bc7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.735491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84450c-88a7-4203-aa4e-513f5eafd536 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.737242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 547/1098] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:04.744285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84450c-88a7-4203-aa4e-513f5eafd536 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.803585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:04.832289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cef9e9-7953-4be3-81e5-2496cf0b09b9 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.858245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84450c-88a7-4203-aa4e-513f5eafd536 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:04.866848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.867454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.867738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.868007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.868729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:04.869031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.870478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.873495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:04.891828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 552/1099] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:04.895251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:04.895868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:04.896153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:04.896431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:04.897166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=5d17fa9d5e034667813e76ef8a39bc7d, user.id=d97b004a6ae245a7ba4a331bf8f6dfee) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:04.897476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:04.897588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:04.899180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:04.904922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 548/1100] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/role_assignments?user.id=d97b004a6ae245a7ba4a331bf8f6dfee&scope.project.id=5d17fa9d5e034667813e76ef8a39bc7d&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:05.004143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2ac6-3baa-4da9-aae1-96194ed01f72 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:05.041299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb752309-0eb7-4181-9e43-bb1cf07cd3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:05.041951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb752309-0eb7-4181-9e43-bb1cf07cd3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:05.042230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb752309-0eb7-4181-9e43-bb1cf07cd3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:05.042500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb752309-0eb7-4181-9e43-bb1cf07cd3e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:05.110596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:05.118248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb752309-0eb7-4181-9e43-bb1cf07cd3e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:05.119730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb752309-0eb7-4181-9e43-bb1cf07cd3e7 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:05.220815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 553/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 06 12:10:05.226605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:05.328297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1e454-5406-4493-b327-377349d65d63 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:05.350160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:05.365164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:05.365791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:05.366074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:05.366348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:05.377612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:05.379063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:10:05.393069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:05.399228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:10:05.400376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:10:05.400376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:10:05.400376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:05.400376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 549/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:05.400666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb752309-0eb7-4181-9e43-bb1cf07cd3e7 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:05.496238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:05.503875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb752309-0eb7-4181-9e43-bb1cf07cd3e7 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:05.541877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:05.542580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:05.542859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:05.543129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:05.543774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:05.544073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:05.546565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:05.557866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 554/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:05.564115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:05.664771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b85ac-7056-4838-9682-8ce9f2851e8a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:05.698256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:05.698881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:05.699160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:05.699429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:05.706259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:05.707698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:10:05.719616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:05.720734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:05.721717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 550/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:05.726538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:05.830447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853be877-d9c4-4c6d-9c60-5d50c7ccb168 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:05.867744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba1f3-4395-4f2d-b269-89bca03ed862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:05.868356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba1f3-4395-4f2d-b269-89bca03ed862 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:05.868635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba1f3-4395-4f2d-b269-89bca03ed862 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:05.868903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba1f3-4395-4f2d-b269-89bca03ed862 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:05.869622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba1f3-4395-4f2d-b269-89bca03ed862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:05.869926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba1f3-4395-4f2d-b269-89bca03ed862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:05.871353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba1f3-4395-4f2d-b269-89bca03ed862 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:05.883803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 555/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:05.890540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:05.924303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:05.997788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce204d3-797e-45dc-9eeb-0412ad006013 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:06.032106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd43b-d717-494f-acf7-2dd297baa161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:06.032718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd43b-d717-494f-acf7-2dd297baa161 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:06.032998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd43b-d717-494f-acf7-2dd297baa161 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:06.033271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd43b-d717-494f-acf7-2dd297baa161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:06.034039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd43b-d717-494f-acf7-2dd297baa161 None admin] RBAC: Adding query filter params (role.id=2b4d2133304046c4a33aae2ed1758aaa, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=1bd257708357455d99990b01af81e5b0) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:06.034347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd43b-d717-494f-acf7-2dd297baa161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:06.035767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd43b-d717-494f-acf7-2dd297baa161 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:06.041750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 551/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:10:05 2022] GET /identity/v3/role_assignments?user.id=1bd257708357455d99990b01af81e5b0&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=2b4d2133304046c4a33aae2ed1758aaa => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:07.157457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee65cac-ab3a-4519-ad79-b16d813a55d1 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:07.158029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee65cac-ab3a-4519-ad79-b16d813a55d1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:07.158132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee65cac-ab3a-4519-ad79-b16d813a55d1 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:07.159536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 556/1107] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:07.164829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e242c-0abb-43d7-98cd-e7f77ecc07f8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:07.165209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e242c-0abb-43d7-98cd-e7f77ecc07f8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:07.165387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e242c-0abb-43d7-98cd-e7f77ecc07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:07.186535 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-592e242c-0abb-43d7-98cd-e7f77ecc07f8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:07.187765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-592e242c-0abb-43d7-98cd-e7f77ecc07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:07.257304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 552/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:07.542027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee65cac-ab3a-4519-ad79-b16d813a55d1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:07.557292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:07.650230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee65cac-ab3a-4519-ad79-b16d813a55d1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:07.687143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d237a-44b6-424e-a71d-7d27acdc1354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:07.687765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d237a-44b6-424e-a71d-7d27acdc1354 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:07.688044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d237a-44b6-424e-a71d-7d27acdc1354 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:07.688316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d237a-44b6-424e-a71d-7d27acdc1354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:07.689422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d237a-44b6-424e-a71d-7d27acdc1354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:07.690882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d237a-44b6-424e-a71d-7d27acdc1354 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:07.692488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 557/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:07.698270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e242c-0abb-43d7-98cd-e7f77ecc07f8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:07.725327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:07.797803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e242c-0abb-43d7-98cd-e7f77ecc07f8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:07.831719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618605ac-e0ac-484c-9015-d0e0e5345b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:07.832329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618605ac-e0ac-484c-9015-d0e0e5345b83 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:07.832613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618605ac-e0ac-484c-9015-d0e0e5345b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:07.832887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618605ac-e0ac-484c-9015-d0e0e5345b83 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:07.833580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618605ac-e0ac-484c-9015-d0e0e5345b83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:07.835007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618605ac-e0ac-484c-9015-d0e0e5345b83 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:07.862254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 553/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:10:07 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:10:10.103884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878cb8-678d-4a28-8c61-a09b86935afe None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:10.104438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878cb8-678d-4a28-8c61-a09b86935afe None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:10.104438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878cb8-678d-4a28-8c61-a09b86935afe None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:10.105775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 558/1111] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:10.111712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c339e6f-6f41-4e76-95fb-c86226244bec None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:10.112130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c339e6f-6f41-4e76-95fb-c86226244bec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:10.112276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c339e6f-6f41-4e76-95fb-c86226244bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:10.131188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2c339e6f-6f41-4e76-95fb-c86226244bec None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:10.132328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c339e6f-6f41-4e76-95fb-c86226244bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:10.210455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 554/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:10.487702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c878cb8-678d-4a28-8c61-a09b86935afe None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:10.570369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:10.590569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c878cb8-678d-4a28-8c61-a09b86935afe None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:10.626801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38d7db-fcd9-414f-938b-e46890a81939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:10.627445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d7db-fcd9-414f-938b-e46890a81939 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:10.627720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d7db-fcd9-414f-938b-e46890a81939 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:10.627985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d7db-fcd9-414f-938b-e46890a81939 None admin] PATH_INFO: `/v3/roles/88a411c5f867401fb95db3c20cd8f8f1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:10.629402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38d7db-fcd9-414f-938b-e46890a81939 None admin] RBAC: Authorizing `identity:get_role(role_id=88a411c5f867401fb95db3c20cd8f8f1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:10.630801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38d7db-fcd9-414f-938b-e46890a81939 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:10.632144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 559/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:10 2022] GET /identity/v3/roles/88a411c5f867401fb95db3c20cd8f8f1 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:10.638035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c339e6f-6f41-4e76-95fb-c86226244bec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:10.653095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:10.739020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c339e6f-6f41-4e76-95fb-c86226244bec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:10.772961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437bea3-b089-496a-80a9-b037aa046473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:10.773862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437bea3-b089-496a-80a9-b037aa046473 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:10.774143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437bea3-b089-496a-80a9-b037aa046473 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:10.774414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437bea3-b089-496a-80a9-b037aa046473 None admin] PATH_INFO: `/v3/users/2d1b963b4708494b871d1ab322c378e9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:10.787856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437bea3-b089-496a-80a9-b037aa046473 None admin] RBAC: Authorizing `identity:get_user(user_id=2d1b963b4708494b871d1ab322c378e9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:10.789289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437bea3-b089-496a-80a9-b037aa046473 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:10.790921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 555/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:10 2022] GET /identity/v3/users/2d1b963b4708494b871d1ab322c378e9 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:10.798143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38d7db-fcd9-414f-938b-e46890a81939 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:10.902595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38d7db-fcd9-414f-938b-e46890a81939 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:10.939684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7d664-25dd-4919-85e5-6ce414361c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:10.940295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7d664-25dd-4919-85e5-6ce414361c31 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:10.940572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7d664-25dd-4919-85e5-6ce414361c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:10.940841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7d664-25dd-4919-85e5-6ce414361c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:10.960346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:11.013559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7d664-25dd-4919-85e5-6ce414361c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:11.014903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7d664-25dd-4919-85e5-6ce414361c31 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:11.116479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 560/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:10:11.123582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437bea3-b089-496a-80a9-b037aa046473 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:11.196659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:11.227303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437bea3-b089-496a-80a9-b037aa046473 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:11.261743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8971fc-a178-444f-a58a-7832d8123d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:11.262375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8971fc-a178-444f-a58a-7832d8123d87 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:11.262657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8971fc-a178-444f-a58a-7832d8123d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:11.262932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8971fc-a178-444f-a58a-7832d8123d87 None admin] PATH_INFO: `/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:11.264316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8971fc-a178-444f-a58a-7832d8123d87 None admin] RBAC: Authorizing `identity:get_project(project_id=5d17fa9d5e034667813e76ef8a39bc7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:11.265729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8971fc-a178-444f-a58a-7832d8123d87 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:11.267388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 556/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:11 2022] GET /identity/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:11.274145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7d664-25dd-4919-85e5-6ce414361c31 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:11.329409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:11.382979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7d664-25dd-4919-85e5-6ce414361c31 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:11.416877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9eea0-34fb-44a5-b964-a7681bf80178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:11.417477 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9eea0-34fb-44a5-b964-a7681bf80178 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:11.417787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9eea0-34fb-44a5-b964-a7681bf80178 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:11.418063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9eea0-34fb-44a5-b964-a7681bf80178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:11.418786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9eea0-34fb-44a5-b964-a7681bf80178 None admin] RBAC: Adding query filter params (role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=5d17fa9d5e034667813e76ef8a39bc7d, user.id=2d1b963b4708494b871d1ab322c378e9) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:11.419094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9eea0-34fb-44a5-b964-a7681bf80178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:11.421528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9eea0-34fb-44a5-b964-a7681bf80178 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:11.426877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 561/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:10:11 2022] GET /identity/v3/role_assignments?user.id=2d1b963b4708494b871d1ab322c378e9&scope.project.id=5d17fa9d5e034667813e76ef8a39bc7d&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:13.573645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497db41d-b428-483d-bdf1-11d8cebd871b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:13.574191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497db41d-b428-483d-bdf1-11d8cebd871b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:13.574191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497db41d-b428-483d-bdf1-11d8cebd871b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:13.576212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 557/1118] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:13.581375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fff53-5b7e-40bd-baf0-b96cc45e3b49 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:13.581812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fff53-5b7e-40bd-baf0-b96cc45e3b49 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:13.581958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fff53-5b7e-40bd-baf0-b96cc45e3b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:13.600591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a50fff53-5b7e-40bd-baf0-b96cc45e3b49 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:13.601829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a50fff53-5b7e-40bd-baf0-b96cc45e3b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:13.667447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 562/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:13.944923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497db41d-b428-483d-bdf1-11d8cebd871b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:14.045636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497db41d-b428-483d-bdf1-11d8cebd871b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:14.079965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f2b1-d54a-4584-985d-691748b738ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:14.080586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f2b1-d54a-4584-985d-691748b738ce None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:14.080865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f2b1-d54a-4584-985d-691748b738ce None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:14.081135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f2b1-d54a-4584-985d-691748b738ce None admin] PATH_INFO: `/v3/roles/88a411c5f867401fb95db3c20cd8f8f1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:14.082530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77f2b1-d54a-4584-985d-691748b738ce None admin] RBAC: Authorizing `identity:get_role(role_id=88a411c5f867401fb95db3c20cd8f8f1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:14.083882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77f2b1-d54a-4584-985d-691748b738ce None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:14.085190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 558/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:13 2022] GET /identity/v3/roles/88a411c5f867401fb95db3c20cd8f8f1 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:14.091746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fff53-5b7e-40bd-baf0-b96cc45e3b49 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:14.141449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:14.199109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fff53-5b7e-40bd-baf0-b96cc45e3b49 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:14.232867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959c85-df4c-450f-8bf7-9b1675573bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:14.233482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959c85-df4c-450f-8bf7-9b1675573bbd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:14.233794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959c85-df4c-450f-8bf7-9b1675573bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:14.234065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959c85-df4c-450f-8bf7-9b1675573bbd None admin] PATH_INFO: `/v3/users/2d1b963b4708494b871d1ab322c378e9` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:14.235189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1959c85-df4c-450f-8bf7-9b1675573bbd None admin] RBAC: Authorizing `identity:get_user(user_id=2d1b963b4708494b871d1ab322c378e9)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:14.236623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1959c85-df4c-450f-8bf7-9b1675573bbd None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:14.238231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 563/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:14 2022] GET /identity/v3/users/2d1b963b4708494b871d1ab322c378e9 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:14.244128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f2b1-d54a-4584-985d-691748b738ce None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:14.253765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:14.346496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f2b1-d54a-4584-985d-691748b738ce None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:14.381317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99392170-1fe9-4d90-9f98-6e9f44b1c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:14.381988 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392170-1fe9-4d90-9f98-6e9f44b1c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:14.382272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392170-1fe9-4d90-9f98-6e9f44b1c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:14.382619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392170-1fe9-4d90-9f98-6e9f44b1c3b4 None admin] PATH_INFO: `/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:14.383700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99392170-1fe9-4d90-9f98-6e9f44b1c3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=5d17fa9d5e034667813e76ef8a39bc7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:14.385147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99392170-1fe9-4d90-9f98-6e9f44b1c3b4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:14.386841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 559/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:14 2022] GET /identity/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:14.395282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959c85-df4c-450f-8bf7-9b1675573bbd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:14.511144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959c85-df4c-450f-8bf7-9b1675573bbd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:14.524794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:14.547352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f65637-ad23-4658-99d8-28f0ce02f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:14.548012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65637-ad23-4658-99d8-28f0ce02f0e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:14.548291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65637-ad23-4658-99d8-28f0ce02f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:14.548564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65637-ad23-4658-99d8-28f0ce02f0e6 None admin] PATH_INFO: `/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d/users/2d1b963b4708494b871d1ab322c378e9/roles/88a411c5f867401fb95db3c20cd8f8f1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:14.550757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f65637-ad23-4658-99d8-28f0ce02f0e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d17fa9d5e034667813e76ef8a39bc7d, user_id=2d1b963b4708494b871d1ab322c378e9, role_id=88a411c5f867401fb95db3c20cd8f8f1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:14.552178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f65637-ad23-4658-99d8-28f0ce02f0e6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:14.565461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 564/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:10:14 2022] PUT /identity/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d/users/2d1b963b4708494b871d1ab322c378e9/roles/88a411c5f867401fb95db3c20cd8f8f1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:10:16.726798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0559914-8519-43c6-bb03-f950d4ba18e9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:16.727358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0559914-8519-43c6-bb03-f950d4ba18e9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:16.727358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0559914-8519-43c6-bb03-f950d4ba18e9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:16.728654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 560/1124] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:16.734114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9428bd-4d24-4910-8690-00ef406df0fc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:16.734528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9428bd-4d24-4910-8690-00ef406df0fc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:16.734639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9428bd-4d24-4910-8690-00ef406df0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:16.753418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-aa9428bd-4d24-4910-8690-00ef406df0fc None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:16.754646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-aa9428bd-4d24-4910-8690-00ef406df0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:16.821131 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 565/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:17.100370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0559914-8519-43c6-bb03-f950d4ba18e9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:17.177186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:17.204224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0559914-8519-43c6-bb03-f950d4ba18e9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:17.236859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a517f6a-cfb5-4c70-88d3-ced3e3cdc5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:17.237482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a517f6a-cfb5-4c70-88d3-ced3e3cdc5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:17.237794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a517f6a-cfb5-4c70-88d3-ced3e3cdc5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:17.238072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a517f6a-cfb5-4c70-88d3-ced3e3cdc5a7 None admin] PATH_INFO: `/v3/roles/88a411c5f867401fb95db3c20cd8f8f1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:17.239458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a517f6a-cfb5-4c70-88d3-ced3e3cdc5a7 None admin] RBAC: Authorizing `identity:get_role(role_id=88a411c5f867401fb95db3c20cd8f8f1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:17.240821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a517f6a-cfb5-4c70-88d3-ced3e3cdc5a7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:17.242170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 561/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:17 2022] GET /identity/v3/roles/88a411c5f867401fb95db3c20cd8f8f1 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:17.248975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9428bd-4d24-4910-8690-00ef406df0fc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:17.347431 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9428bd-4d24-4910-8690-00ef406df0fc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:17.348945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:17.387185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c23a2-ef28-4a89-9248-d0eb5d61129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:17.388002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c23a2-ef28-4a89-9248-d0eb5d61129b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:17.388500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c23a2-ef28-4a89-9248-d0eb5d61129b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:17.388695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c23a2-ef28-4a89-9248-d0eb5d61129b None admin] PATH_INFO: `/v3/users/2d1b963b4708494b871d1ab322c378e9` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:17.389850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c23a2-ef28-4a89-9248-d0eb5d61129b None admin] RBAC: Authorizing `identity:get_user(user_id=2d1b963b4708494b871d1ab322c378e9)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:17.391272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c23a2-ef28-4a89-9248-d0eb5d61129b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:17.392841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 566/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:17 2022] GET /identity/v3/users/2d1b963b4708494b871d1ab322c378e9 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:17.398882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a517f6a-cfb5-4c70-88d3-ced3e3cdc5a7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:17.500669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a517f6a-cfb5-4c70-88d3-ced3e3cdc5a7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:17.534574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27401004-e6ce-4458-8aec-c30acba73806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:17.535184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27401004-e6ce-4458-8aec-c30acba73806 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:17.535468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27401004-e6ce-4458-8aec-c30acba73806 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:17.535743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27401004-e6ce-4458-8aec-c30acba73806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:17.548181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:17.604223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27401004-e6ce-4458-8aec-c30acba73806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:17.605690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27401004-e6ce-4458-8aec-c30acba73806 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:17.700001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 562/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:10:17.705892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c23a2-ef28-4a89-9248-d0eb5d61129b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:17.805525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c23a2-ef28-4a89-9248-d0eb5d61129b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:17.837883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36441e8d-f826-4d63-9782-a963a047bf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:17.838503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441e8d-f826-4d63-9782-a963a047bf6d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:17.838781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441e8d-f826-4d63-9782-a963a047bf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:17.839056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441e8d-f826-4d63-9782-a963a047bf6d None admin] PATH_INFO: `/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:17.840157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36441e8d-f826-4d63-9782-a963a047bf6d None admin] RBAC: Authorizing `identity:get_project(project_id=5d17fa9d5e034667813e76ef8a39bc7d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:17.842185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36441e8d-f826-4d63-9782-a963a047bf6d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:17.843825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 567/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:17 2022] GET /identity/v3/projects/5d17fa9d5e034667813e76ef8a39bc7d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:17.850919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27401004-e6ce-4458-8aec-c30acba73806 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:17.902434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:17.974161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27401004-e6ce-4458-8aec-c30acba73806 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:18.007026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b756b-131e-47c8-b478-bb7eb0a5763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:18.007626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b756b-131e-47c8-b478-bb7eb0a5763b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:18.007909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b756b-131e-47c8-b478-bb7eb0a5763b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:18.008183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b756b-131e-47c8-b478-bb7eb0a5763b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:18.008911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b756b-131e-47c8-b478-bb7eb0a5763b None admin] RBAC: Adding query filter params (role.id=88a411c5f867401fb95db3c20cd8f8f1, scope.project.id=5d17fa9d5e034667813e76ef8a39bc7d, user.id=2d1b963b4708494b871d1ab322c378e9) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:18.009219 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b756b-131e-47c8-b478-bb7eb0a5763b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:18.010691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b756b-131e-47c8-b478-bb7eb0a5763b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:18.017368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 563/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:10:17 2022] GET /identity/v3/role_assignments?user.id=2d1b963b4708494b871d1ab322c378e9&scope.project.id=5d17fa9d5e034667813e76ef8a39bc7d&role.id=88a411c5f867401fb95db3c20cd8f8f1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:20.211868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3f00-e1f5-489e-a5e8-2e04b6046c46 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:20.212437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3f00-e1f5-489e-a5e8-2e04b6046c46 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:20.212437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3f00-e1f5-489e-a5e8-2e04b6046c46 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:20.213783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 568/1131] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:20.219857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27085d0-f5a3-401c-bb6d-21ccb74666c0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:20.220337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27085d0-f5a3-401c-bb6d-21ccb74666c0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:20.220459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27085d0-f5a3-401c-bb6d-21ccb74666c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:20.239875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d27085d0-f5a3-401c-bb6d-21ccb74666c0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:20.241076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d27085d0-f5a3-401c-bb6d-21ccb74666c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:20.312476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 564/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:20.580628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3f00-e1f5-489e-a5e8-2e04b6046c46 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:20.621966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:20.682027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3f00-e1f5-489e-a5e8-2e04b6046c46 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:20.714595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea2567-0b21-4435-a3f0-dc6367e77588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:20.715207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea2567-0b21-4435-a3f0-dc6367e77588 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:20.716008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea2567-0b21-4435-a3f0-dc6367e77588 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:20.716281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea2567-0b21-4435-a3f0-dc6367e77588 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:20.717587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea2567-0b21-4435-a3f0-dc6367e77588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:20.719021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea2567-0b21-4435-a3f0-dc6367e77588 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:20.720569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 569/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:10:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:20.726467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27085d0-f5a3-401c-bb6d-21ccb74666c0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:20.759301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:20.820881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27085d0-f5a3-401c-bb6d-21ccb74666c0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:20.853713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660f5ca-c4a5-48c3-a4d5-b4d0c647f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:20.854249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660f5ca-c4a5-48c3-a4d5-b4d0c647f6cd None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:20.854529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660f5ca-c4a5-48c3-a4d5-b4d0c647f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:20.854802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660f5ca-c4a5-48c3-a4d5-b4d0c647f6cd None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:20.855444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660f5ca-c4a5-48c3-a4d5-b4d0c647f6cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:20.857753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660f5ca-c4a5-48c3-a4d5-b4d0c647f6cd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:20.884926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 565/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:10:20 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:10:23.111829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893dd81-6131-40ce-aade-81cebe613e71 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:23.112366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893dd81-6131-40ce-aade-81cebe613e71 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:23.112366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893dd81-6131-40ce-aade-81cebe613e71 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:23.113735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 570/1135] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:23.119016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2577-6c3e-4a5d-b013-9b5d8fc38c52 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:23.119446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2577-6c3e-4a5d-b013-9b5d8fc38c52 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:23.119567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2577-6c3e-4a5d-b013-9b5d8fc38c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:23.138700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9a3f2577-6c3e-4a5d-b013-9b5d8fc38c52 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:23.139906 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a3f2577-6c3e-4a5d-b013-9b5d8fc38c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:23.206578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 566/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:10:23.501709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893dd81-6131-40ce-aade-81cebe613e71 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:23.604358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893dd81-6131-40ce-aade-81cebe613e71 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:23.612326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:23.639188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8a71-4cb7-40ee-af34-53b452d47ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:23.639806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8a71-4cb7-40ee-af34-53b452d47ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:23.640080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8a71-4cb7-40ee-af34-53b452d47ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:23.640348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8a71-4cb7-40ee-af34-53b452d47ba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:23.641446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee8a71-4cb7-40ee-af34-53b452d47ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:23.642907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee8a71-4cb7-40ee-af34-53b452d47ba2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:23.644463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 571/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:10:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:23.650588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f2577-6c3e-4a5d-b013-9b5d8fc38c52 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:23.667998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:23.752274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f2577-6c3e-4a5d-b013-9b5d8fc38c52 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:23.789772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd1a4e-0f6a-4189-b8d0-618fadcc37d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:23.790639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd1a4e-0f6a-4189-b8d0-618fadcc37d2 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:23.791067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd1a4e-0f6a-4189-b8d0-618fadcc37d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:23.791476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd1a4e-0f6a-4189-b8d0-618fadcc37d2 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:23.792488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd1a4e-0f6a-4189-b8d0-618fadcc37d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:23.795243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd1a4e-0f6a-4189-b8d0-618fadcc37d2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:23.824959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 567/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:10:23 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:10:26.058345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69add2-ab1a-496b-ade9-b5d03eee4325 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:26.059078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69add2-ab1a-496b-ade9-b5d03eee4325 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:26.059078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69add2-ab1a-496b-ade9-b5d03eee4325 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:26.060350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 572/1139] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:26.066190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea23b2-caaf-427d-8a37-0f78b8e586fb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:26.066719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea23b2-caaf-427d-8a37-0f78b8e586fb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:26.066719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea23b2-caaf-427d-8a37-0f78b8e586fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:26.086979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-86ea23b2-caaf-427d-8a37-0f78b8e586fb None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:26.088201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-86ea23b2-caaf-427d-8a37-0f78b8e586fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:26.161805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 568/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:26.435434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69add2-ab1a-496b-ade9-b5d03eee4325 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:26.551603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69add2-ab1a-496b-ade9-b5d03eee4325 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:26.586576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eb96a-a0dd-45f0-95a0-ba7821e80735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:26.587213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb96a-a0dd-45f0-95a0-ba7821e80735 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:26.587496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb96a-a0dd-45f0-95a0-ba7821e80735 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:26.587784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb96a-a0dd-45f0-95a0-ba7821e80735 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:26.598978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79eb96a-a0dd-45f0-95a0-ba7821e80735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f79eb96a-a0dd-45f0-95a0-ba7821e80735 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:26.603882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:26.605082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:26.606985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 573/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:26.611831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea23b2-caaf-427d-8a37-0f78b8e586fb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:26.614996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:26.712936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea23b2-caaf-427d-8a37-0f78b8e586fb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:26.749592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:26.750212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:26.750500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:26.750775 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:26.751456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:26.751763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:26.753149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:26.762303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 569/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:10:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:26.769402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eb96a-a0dd-45f0-95a0-ba7821e80735 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:26.807914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:26.880323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eb96a-a0dd-45f0-95a0-ba7821e80735 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:26.930332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee867-2485-4a85-acb3-7a6217a18e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:26.930994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee867-2485-4a85-acb3-7a6217a18e0f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:26.931276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee867-2485-4a85-acb3-7a6217a18e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:26.931549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee867-2485-4a85-acb3-7a6217a18e0f None admin] PATH_INFO: `/v3/users/a9bc07f3438747a2b22f23efef869003` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:26.947152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ee867-2485-4a85-acb3-7a6217a18e0f None admin] RBAC: Authorizing `identity:get_user(user_id=a9bc07f3438747a2b22f23efef869003)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:26.948622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ee867-2485-4a85-acb3-7a6217a18e0f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:26.950640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 574/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:26 2022] GET /identity/v3/users/a9bc07f3438747a2b22f23efef869003 => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:26.956572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:27.033080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:27.074133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b4fc-072d-43c4-a032-b4ec2befba66 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:27.114181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aecc0-312a-4115-bea2-fcdf1e521157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:27.114797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aecc0-312a-4115-bea2-fcdf1e521157 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:27.115082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aecc0-312a-4115-bea2-fcdf1e521157 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:27.115358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aecc0-312a-4115-bea2-fcdf1e521157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:27.191116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8aecc0-312a-4115-bea2-fcdf1e521157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:27.192630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8aecc0-312a-4115-bea2-fcdf1e521157 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:27.266860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:27.308640 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 570/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:10:27.315024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee867-2485-4a85-acb3-7a6217a18e0f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:27.411043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:27.420976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee867-2485-4a85-acb3-7a6217a18e0f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:27.475884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c6525-886c-412a-8d93-14240933535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:27.476925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c6525-886c-412a-8d93-14240933535b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:27.477414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c6525-886c-412a-8d93-14240933535b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:27.477907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c6525-886c-412a-8d93-14240933535b None admin] PATH_INFO: `/v3/projects/c7af889183b64306b0b4d2a09f3bdaff` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:27.479881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c6525-886c-412a-8d93-14240933535b None admin] RBAC: Authorizing `identity:get_project(project_id=c7af889183b64306b0b4d2a09f3bdaff)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:27.482017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c6525-886c-412a-8d93-14240933535b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:27.483716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 575/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:27 2022] GET /identity/v3/projects/c7af889183b64306b0b4d2a09f3bdaff => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:27.493773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aecc0-312a-4115-bea2-fcdf1e521157 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:27.602136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aecc0-312a-4115-bea2-fcdf1e521157 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:27.638086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dd67d-f06e-42fe-836c-c4d5779e129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:27.638691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd67d-f06e-42fe-836c-c4d5779e129b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:27.638971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd67d-f06e-42fe-836c-c4d5779e129b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:27.639245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd67d-f06e-42fe-836c-c4d5779e129b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:27.639981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dd67d-f06e-42fe-836c-c4d5779e129b None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=c7af889183b64306b0b4d2a09f3bdaff, user.id=a9bc07f3438747a2b22f23efef869003) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:27.640286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dd67d-f06e-42fe-836c-c4d5779e129b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:27.641729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dd67d-f06e-42fe-836c-c4d5779e129b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:27.648457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 571/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:10:27 2022] GET /identity/v3/role_assignments?user.id=a9bc07f3438747a2b22f23efef869003&scope.project.id=c7af889183b64306b0b4d2a09f3bdaff&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:29.875589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9bc7a-2fae-48c0-884e-5d3b6ffef601 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:29.876186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9bc7a-2fae-48c0-884e-5d3b6ffef601 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:29.876186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9bc7a-2fae-48c0-884e-5d3b6ffef601 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:29.877506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 576/1147] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:29.883492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7da5-9a07-4dc6-a911-d42cf7dc8b95 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:29.884428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7da5-9a07-4dc6-a911-d42cf7dc8b95 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:29.884428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7da5-9a07-4dc6-a911-d42cf7dc8b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:29.904674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fd8a7da5-9a07-4dc6-a911-d42cf7dc8b95 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:29.905943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd8a7da5-9a07-4dc6-a911-d42cf7dc8b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:29.932275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:29.989721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 572/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:10:30.260553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9bc7a-2fae-48c0-884e-5d3b6ffef601 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:30.389926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9bc7a-2fae-48c0-884e-5d3b6ffef601 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:30.428337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95736b2b-b860-48fd-8a73-a4f3a27eff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:30.428983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95736b2b-b860-48fd-8a73-a4f3a27eff8a None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:30.429255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95736b2b-b860-48fd-8a73-a4f3a27eff8a None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:30.429524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95736b2b-b860-48fd-8a73-a4f3a27eff8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:30.440665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95736b2b-b860-48fd-8a73-a4f3a27eff8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-95736b2b-b860-48fd-8a73-a4f3a27eff8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:30.445488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:30.449595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:30.450918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 577/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:10:30.452953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7da5-9a07-4dc6-a911-d42cf7dc8b95 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:30.555968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7da5-9a07-4dc6-a911-d42cf7dc8b95 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:30.593781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:30.594414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:30.594701 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:30.594977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:30.595666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:30.595983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:30.597380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:30.606875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 573/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:30.612842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95736b2b-b860-48fd-8a73-a4f3a27eff8a None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:30.637492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:30.722653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95736b2b-b860-48fd-8a73-a4f3a27eff8a None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:30.758252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939e16b-3b14-441e-9869-4447259ae497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:30.758891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e16b-3b14-441e-9869-4447259ae497 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:30.759166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e16b-3b14-441e-9869-4447259ae497 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:30.759435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e16b-3b14-441e-9869-4447259ae497 None admin] PATH_INFO: `/v3/users/a9bc07f3438747a2b22f23efef869003` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:30.760598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939e16b-3b14-441e-9869-4447259ae497 None admin] RBAC: Authorizing `identity:get_user(user_id=a9bc07f3438747a2b22f23efef869003)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:30.762124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939e16b-3b14-441e-9869-4447259ae497 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:30.763758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 578/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:30 2022] GET /identity/v3/users/a9bc07f3438747a2b22f23efef869003 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:30.769865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:30.798107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:30.883077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f75d30-4c29-4a59-83fc-f75f05bd6130 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:30.922254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9902-151c-4a59-b1bb-c25a2d63957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:30.922927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9902-151c-4a59-b1bb-c25a2d63957c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:30.923159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9902-151c-4a59-b1bb-c25a2d63957c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:30.923435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9902-151c-4a59-b1bb-c25a2d63957c None admin] PATH_INFO: `/v3/projects/c7af889183b64306b0b4d2a09f3bdaff` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:30.924566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff9902-151c-4a59-b1bb-c25a2d63957c None admin] RBAC: Authorizing `identity:get_project(project_id=c7af889183b64306b0b4d2a09f3bdaff)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:30.926037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff9902-151c-4a59-b1bb-c25a2d63957c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:30.927710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 574/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:30 2022] GET /identity/v3/projects/c7af889183b64306b0b4d2a09f3bdaff => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:30.933828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939e16b-3b14-441e-9869-4447259ae497 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:31.046537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:31.059974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939e16b-3b14-441e-9869-4447259ae497 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:31.098859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9028a2-cf0d-49cf-95af-d7bbd6742627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:31.099543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9028a2-cf0d-49cf-95af-d7bbd6742627 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:31.099824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9028a2-cf0d-49cf-95af-d7bbd6742627 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:31.100097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9028a2-cf0d-49cf-95af-d7bbd6742627 None admin] PATH_INFO: `/v3/projects/c7af889183b64306b0b4d2a09f3bdaff/users/a9bc07f3438747a2b22f23efef869003/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:31.102072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9028a2-cf0d-49cf-95af-d7bbd6742627 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7af889183b64306b0b4d2a09f3bdaff, user_id=a9bc07f3438747a2b22f23efef869003, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:31.103506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9028a2-cf0d-49cf-95af-d7bbd6742627 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:31.117856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 579/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:10:30 2022] PUT /identity/v3/projects/c7af889183b64306b0b4d2a09f3bdaff/users/a9bc07f3438747a2b22f23efef869003/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:10:33.313964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56749-40cd-419f-975e-fad23dbace5f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:33.314523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56749-40cd-419f-975e-fad23dbace5f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:33.314523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56749-40cd-419f-975e-fad23dbace5f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:33.315891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 575/1154] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:33.321370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cdbf7-9aa4-48cf-86e3-615a50e88ff1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:33.321860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cdbf7-9aa4-48cf-86e3-615a50e88ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:33.321950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cdbf7-9aa4-48cf-86e3-615a50e88ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:33.341329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a85cdbf7-9aa4-48cf-86e3-615a50e88ff1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:33.342554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a85cdbf7-9aa4-48cf-86e3-615a50e88ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:33.412569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 580/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:33.688559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe56749-40cd-419f-975e-fad23dbace5f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:33.782738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:33.794630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe56749-40cd-419f-975e-fad23dbace5f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:33.833978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222aa30-9351-48fa-b478-ccee3fc80708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:33.834614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222aa30-9351-48fa-b478-ccee3fc80708 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:33.834899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222aa30-9351-48fa-b478-ccee3fc80708 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:33.835175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222aa30-9351-48fa-b478-ccee3fc80708 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:33.846294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222aa30-9351-48fa-b478-ccee3fc80708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1222aa30-9351-48fa-b478-ccee3fc80708 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:33.851131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:33.852292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:33.853614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 576/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:10:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:10:33.858999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cdbf7-9aa4-48cf-86e3-615a50e88ff1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:33.943876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:33.969875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cdbf7-9aa4-48cf-86e3-615a50e88ff1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:34.008659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:34.009280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:34.009582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:34.009868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:34.010544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:34.010849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:34.012790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:34.021781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 581/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:10:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:34.028241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222aa30-9351-48fa-b478-ccee3fc80708 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:34.130380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222aa30-9351-48fa-b478-ccee3fc80708 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:34.166133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531efd-e564-48c4-96c3-c8bcb49db7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:34.166771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531efd-e564-48c4-96c3-c8bcb49db7bf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:34.167058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531efd-e564-48c4-96c3-c8bcb49db7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:34.167343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531efd-e564-48c4-96c3-c8bcb49db7bf None admin] PATH_INFO: `/v3/users/a9bc07f3438747a2b22f23efef869003` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:34.168939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c531efd-e564-48c4-96c3-c8bcb49db7bf None admin] RBAC: Authorizing `identity:get_user(user_id=a9bc07f3438747a2b22f23efef869003)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:34.170406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c531efd-e564-48c4-96c3-c8bcb49db7bf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:34.172011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 577/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:34 2022] GET /identity/v3/users/a9bc07f3438747a2b22f23efef869003 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:34.177850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:34.287936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a79fb0-4ca2-4857-8984-3d304c86bf80 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:34.329297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4efc83-a3d5-4330-9bf7-6de67c73690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:34.330013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4efc83-a3d5-4330-9bf7-6de67c73690e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:34.330222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4efc83-a3d5-4330-9bf7-6de67c73690e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:34.330497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4efc83-a3d5-4330-9bf7-6de67c73690e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:34.343189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:34.407670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4efc83-a3d5-4330-9bf7-6de67c73690e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:34.410052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4efc83-a3d5-4330-9bf7-6de67c73690e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:34.532717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 582/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:10:34.539029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531efd-e564-48c4-96c3-c8bcb49db7bf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:34.559699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:34.644947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531efd-e564-48c4-96c3-c8bcb49db7bf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:34.691445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ac8f2-42e8-4966-bd6f-7d263bcfc56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:34.692104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ac8f2-42e8-4966-bd6f-7d263bcfc56d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:34.692386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ac8f2-42e8-4966-bd6f-7d263bcfc56d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:34.692660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ac8f2-42e8-4966-bd6f-7d263bcfc56d None admin] PATH_INFO: `/v3/projects/c7af889183b64306b0b4d2a09f3bdaff` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:34.693935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ac8f2-42e8-4966-bd6f-7d263bcfc56d None admin] RBAC: Authorizing `identity:get_project(project_id=c7af889183b64306b0b4d2a09f3bdaff)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:34.695409 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ac8f2-42e8-4966-bd6f-7d263bcfc56d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:34.697131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 578/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:34 2022] GET /identity/v3/projects/c7af889183b64306b0b4d2a09f3bdaff => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:34.706831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4efc83-a3d5-4330-9bf7-6de67c73690e None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:34.752055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:34.821003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4efc83-a3d5-4330-9bf7-6de67c73690e None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:34.860988 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba27b5-343c-4347-a17e-9cd717142ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:34.861621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba27b5-343c-4347-a17e-9cd717142ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:34.861902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba27b5-343c-4347-a17e-9cd717142ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:34.862173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba27b5-343c-4347-a17e-9cd717142ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:34.862903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba27b5-343c-4347-a17e-9cd717142ab2 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=c7af889183b64306b0b4d2a09f3bdaff, user.id=a9bc07f3438747a2b22f23efef869003) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:34.863213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba27b5-343c-4347-a17e-9cd717142ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:34.864640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba27b5-343c-4347-a17e-9cd717142ab2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:34.871304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 583/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:10:34 2022] GET /identity/v3/role_assignments?user.id=a9bc07f3438747a2b22f23efef869003&scope.project.id=c7af889183b64306b0b4d2a09f3bdaff&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:37.130174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a5b7c-ebb4-453e-a40b-185492b4859b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:37.130805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a5b7c-ebb4-453e-a40b-185492b4859b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:37.131081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a5b7c-ebb4-453e-a40b-185492b4859b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:37.132539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 579/1162] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:37.140079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501632-be78-42a3-87ca-87f11a0f25ed None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:37.140708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501632-be78-42a3-87ca-87f11a0f25ed None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:37.140708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501632-be78-42a3-87ca-87f11a0f25ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:37.160355 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7b501632-be78-42a3-87ca-87f11a0f25ed None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:37.161621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7b501632-be78-42a3-87ca-87f11a0f25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:37.229144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 584/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:37.502711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a5b7c-ebb4-453e-a40b-185492b4859b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:37.593210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:37.613800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a5b7c-ebb4-453e-a40b-185492b4859b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:37.654139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465c430-6c37-4dc4-9445-dae0d4c7c138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:37.654742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465c430-6c37-4dc4-9445-dae0d4c7c138 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:37.655030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465c430-6c37-4dc4-9445-dae0d4c7c138 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:37.655309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465c430-6c37-4dc4-9445-dae0d4c7c138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:37.729560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465c430-6c37-4dc4-9445-dae0d4c7c138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:37.731259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465c430-6c37-4dc4-9445-dae0d4c7c138 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:37.826244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:37.841912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 580/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:10:37.847999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501632-be78-42a3-87ca-87f11a0f25ed None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:37.882374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:37.953501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501632-be78-42a3-87ca-87f11a0f25ed None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:37.989529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811582-8054-4242-ac17-636c9b8a1c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:37.990202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811582-8054-4242-ac17-636c9b8a1c9e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:37.990483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811582-8054-4242-ac17-636c9b8a1c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:37.990757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811582-8054-4242-ac17-636c9b8a1c9e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:37.998435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d811582-8054-4242-ac17-636c9b8a1c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:37.999891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d811582-8054-4242-ac17-636c9b8a1c9e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-6d811582-8054-4242-ac17-636c9b8a1c9e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:38.011781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:38.013042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:38.014292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 585/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:10:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:10:38.019128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465c430-6c37-4dc4-9445-dae0d4c7c138 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:38.123883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465c430-6c37-4dc4-9445-dae0d4c7c138 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:38.161200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440706b6-fcef-4a9b-8e51-e24bae8adde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:38.161896 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440706b6-fcef-4a9b-8e51-e24bae8adde9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:38.162123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440706b6-fcef-4a9b-8e51-e24bae8adde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:38.162397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440706b6-fcef-4a9b-8e51-e24bae8adde9 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:38.163062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440706b6-fcef-4a9b-8e51-e24bae8adde9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:38.163370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440706b6-fcef-4a9b-8e51-e24bae8adde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:38.164757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440706b6-fcef-4a9b-8e51-e24bae8adde9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:38.173062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 581/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Oct 6 12:10:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:40.389219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692f13f-10e3-42a8-aff0-7ec006c22f44 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:40.389760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692f13f-10e3-42a8-aff0-7ec006c22f44 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:40.389760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692f13f-10e3-42a8-aff0-7ec006c22f44 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:40.391052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 586/1167] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:40.396379 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0b849-b3d6-45a4-8162-21fe8fcb87ad None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:40.397061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0b849-b3d6-45a4-8162-21fe8fcb87ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:40.397191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0b849-b3d6-45a4-8162-21fe8fcb87ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:40.415732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-51e0b849-b3d6-45a4-8162-21fe8fcb87ad None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:40.416966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-51e0b849-b3d6-45a4-8162-21fe8fcb87ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:40.476131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:40.500757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 582/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:10:40.770791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692f13f-10e3-42a8-aff0-7ec006c22f44 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:40.869600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:40.884238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692f13f-10e3-42a8-aff0-7ec006c22f44 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:40.921676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526e82b-cd0a-411b-be4e-a107d12a2333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:40.922273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e82b-cd0a-411b-be4e-a107d12a2333 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:40.927672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e82b-cd0a-411b-be4e-a107d12a2333 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:40.927672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e82b-cd0a-411b-be4e-a107d12a2333 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:40.927672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526e82b-cd0a-411b-be4e-a107d12a2333 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:40.927672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526e82b-cd0a-411b-be4e-a107d12a2333 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:40.942671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 587/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu Oct 6 12:10:40 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:10:43.163294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46811daf-adcb-4445-ad4f-154dd8614c7f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:43.163890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46811daf-adcb-4445-ad4f-154dd8614c7f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:43.163890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46811daf-adcb-4445-ad4f-154dd8614c7f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:43.165172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 583/1170] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:43.170679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225be42-5071-4061-98cc-c3a5a871169e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:43.171230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225be42-5071-4061-98cc-c3a5a871169e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:43.171230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225be42-5071-4061-98cc-c3a5a871169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:43.190889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7225be42-5071-4061-98cc-c3a5a871169e None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:43.192099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7225be42-5071-4061-98cc-c3a5a871169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:43.260149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 588/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:43.531441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46811daf-adcb-4445-ad4f-154dd8614c7f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:43.632833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46811daf-adcb-4445-ad4f-154dd8614c7f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:43.666288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99e552-0ab2-4343-a549-c42007f32be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:43.667078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99e552-0ab2-4343-a549-c42007f32be2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:43.667363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99e552-0ab2-4343-a549-c42007f32be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:43.667641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99e552-0ab2-4343-a549-c42007f32be2 None admin] PATH_INFO: `/v3/domains/38d2f1649d6e4af98cd35310616eb7f5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:43.677783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99e552-0ab2-4343-a549-c42007f32be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=38d2f1649d6e4af98cd35310616eb7f5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:43.679226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99e552-0ab2-4343-a549-c42007f32be2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:43.680809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 584/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Oct 6 12:10:43 2022] GET /identity/v3/domains/38d2f1649d6e4af98cd35310616eb7f5 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:43.687390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225be42-5071-4061-98cc-c3a5a871169e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:43.770622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:43.787404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225be42-5071-4061-98cc-c3a5a871169e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:43.821300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4569d5-af94-41ac-a802-8559d854cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:43.821952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4569d5-af94-41ac-a802-8559d854cc7e None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:43.822234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4569d5-af94-41ac-a802-8559d854cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:43.822506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4569d5-af94-41ac-a802-8559d854cc7e None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:43.823384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4569d5-af94-41ac-a802-8559d854cc7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:43.824949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4569d5-af94-41ac-a802-8559d854cc7e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:43.853421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 589/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:10:43 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:10:46.083966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d5b8-7036-4427-811a-fb96abc10ffc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:46.084563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d5b8-7036-4427-811a-fb96abc10ffc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:46.084563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d5b8-7036-4427-811a-fb96abc10ffc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:46.086034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 585/1174] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:46.092068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ada6-aaf2-4b34-81d6-449480af67d1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:46.092496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ada6-aaf2-4b34-81d6-449480af67d1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:46.092622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ada6-aaf2-4b34-81d6-449480af67d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:46.111572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0bd1ada6-aaf2-4b34-81d6-449480af67d1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:46.112763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0bd1ada6-aaf2-4b34-81d6-449480af67d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:46.180950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 590/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:46.455088 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d5b8-7036-4427-811a-fb96abc10ffc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:46.498799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:46.566461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d5b8-7036-4427-811a-fb96abc10ffc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:46.604396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71015009-ac30-440d-bd88-9e5c29bd3be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:46.605090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71015009-ac30-440d-bd88-9e5c29bd3be1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:46.605372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71015009-ac30-440d-bd88-9e5c29bd3be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:46.605746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71015009-ac30-440d-bd88-9e5c29bd3be1 None admin] PATH_INFO: `/v3/domains/38d2f1649d6e4af98cd35310616eb7f5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:46.607386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71015009-ac30-440d-bd88-9e5c29bd3be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=38d2f1649d6e4af98cd35310616eb7f5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:46.608820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71015009-ac30-440d-bd88-9e5c29bd3be1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:46.610430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 586/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Oct 6 12:10:46 2022] GET /identity/v3/domains/38d2f1649d6e4af98cd35310616eb7f5 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:46.616797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ada6-aaf2-4b34-81d6-449480af67d1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:46.688021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:46.723991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ada6-aaf2-4b34-81d6-449480af67d1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:46.758377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd3ab1-c854-422e-b362-b2b02d40e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:46.758979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd3ab1-c854-422e-b362-b2b02d40e00c None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:46.759255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd3ab1-c854-422e-b362-b2b02d40e00c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:46.759525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd3ab1-c854-422e-b362-b2b02d40e00c None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:46.760731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd3ab1-c854-422e-b362-b2b02d40e00c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:46.762187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd3ab1-c854-422e-b362-b2b02d40e00c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:46.785879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 591/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:10:46 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:10:49.187808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d7e92-3bca-4522-be64-983436a38a2a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:49.188368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d7e92-3bca-4522-be64-983436a38a2a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:49.188368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d7e92-3bca-4522-be64-983436a38a2a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:49.189702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 587/1178] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:49.195058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e5e6d-d19f-4a19-a081-c3d1db1e88af None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:49.195473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e5e6d-d19f-4a19-a081-c3d1db1e88af None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:49.195604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e5e6d-d19f-4a19-a081-c3d1db1e88af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:49.215664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-092e5e6d-d19f-4a19-a081-c3d1db1e88af None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:49.216868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-092e5e6d-d19f-4a19-a081-c3d1db1e88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:49.285595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 592/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:49.567478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d7e92-3bca-4522-be64-983436a38a2a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:49.667891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d7e92-3bca-4522-be64-983436a38a2a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:49.676360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:49.704729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea347acd-e582-4a27-907b-339c2511a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:49.705355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea347acd-e582-4a27-907b-339c2511a995 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:49.705676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea347acd-e582-4a27-907b-339c2511a995 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:49.705957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea347acd-e582-4a27-907b-339c2511a995 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:49.717550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea347acd-e582-4a27-907b-339c2511a995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ea347acd-e582-4a27-907b-339c2511a995 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:49.722277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:49.723880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:49.725608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 588/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:10:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:10:49.730585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e5e6d-d19f-4a19-a081-c3d1db1e88af None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:49.787459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:49.841200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e5e6d-d19f-4a19-a081-c3d1db1e88af None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:49.878370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:49.878976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:49.879259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:49.879535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:49.880209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:49.880515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:49.881935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:49.891074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 593/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:49.897383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea347acd-e582-4a27-907b-339c2511a995 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:50.001620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea347acd-e582-4a27-907b-339c2511a995 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:50.036793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085802e-e88c-4673-bebc-7799cd5bdeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:50.037418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085802e-e88c-4673-bebc-7799cd5bdeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:50.037733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085802e-e88c-4673-bebc-7799cd5bdeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:50.038009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085802e-e88c-4673-bebc-7799cd5bdeb9 None admin] PATH_INFO: `/v3/users/fb123dae274940efb01fd742e0cba527` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:50.051531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085802e-e88c-4673-bebc-7799cd5bdeb9 None admin] RBAC: Authorizing `identity:get_user(user_id=fb123dae274940efb01fd742e0cba527)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:50.053160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085802e-e88c-4673-bebc-7799cd5bdeb9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:50.054831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 589/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:49 2022] GET /identity/v3/users/fb123dae274940efb01fd742e0cba527 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:50.064343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:50.169924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3de702-9c23-4cc4-9c92-64790ab53510 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:50.183202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:50.203588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2d463-5c32-489e-a5b6-7e7aa88c301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:50.204262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2d463-5c32-489e-a5b6-7e7aa88c301c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:50.204437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2d463-5c32-489e-a5b6-7e7aa88c301c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:50.204701 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2d463-5c32-489e-a5b6-7e7aa88c301c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:50.282185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2d463-5c32-489e-a5b6-7e7aa88c301c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:50.283633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2d463-5c32-489e-a5b6-7e7aa88c301c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:50.384602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 594/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:10:50.390741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085802e-e88c-4673-bebc-7799cd5bdeb9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:50.424125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:50.506003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085802e-e88c-4673-bebc-7799cd5bdeb9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:50.544648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aef449-36d3-43bd-b645-4fa93f3cbd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:50.545284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef449-36d3-43bd-b645-4fa93f3cbd58 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:50.545588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef449-36d3-43bd-b645-4fa93f3cbd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:50.545865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef449-36d3-43bd-b645-4fa93f3cbd58 None admin] PATH_INFO: `/v3/projects/12905f53b35549e68ef2e259fb87e231` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:50.547238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aef449-36d3-43bd-b645-4fa93f3cbd58 None admin] RBAC: Authorizing `identity:get_project(project_id=12905f53b35549e68ef2e259fb87e231)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:50.548702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aef449-36d3-43bd-b645-4fa93f3cbd58 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:50.550398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 590/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:50 2022] GET /identity/v3/projects/12905f53b35549e68ef2e259fb87e231 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:50.556699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2d463-5c32-489e-a5b6-7e7aa88c301c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:50.574644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:50.676010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2d463-5c32-489e-a5b6-7e7aa88c301c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:50.723193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05892d8d-805c-41d1-a5e5-f6f4ca993347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:50.724129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892d8d-805c-41d1-a5e5-f6f4ca993347 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:50.724414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892d8d-805c-41d1-a5e5-f6f4ca993347 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:50.724689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892d8d-805c-41d1-a5e5-f6f4ca993347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:50.725875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05892d8d-805c-41d1-a5e5-f6f4ca993347 None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12905f53b35549e68ef2e259fb87e231, user.id=fb123dae274940efb01fd742e0cba527) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:50.726430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05892d8d-805c-41d1-a5e5-f6f4ca993347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:50.727912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05892d8d-805c-41d1-a5e5-f6f4ca993347 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:50.734721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 595/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:10:50 2022] GET /identity/v3/role_assignments?user.id=fb123dae274940efb01fd742e0cba527&scope.project.id=12905f53b35549e68ef2e259fb87e231&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:52.918277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ac832-4a0d-4d34-826f-3c66d65dccbe None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:52.918844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ac832-4a0d-4d34-826f-3c66d65dccbe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:52.918844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ac832-4a0d-4d34-826f-3c66d65dccbe None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:52.920144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 591/1186] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:52.925423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833dab6-77a0-4abb-9bc6-3e00849efd5b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:52.925863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833dab6-77a0-4abb-9bc6-3e00849efd5b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:52.925989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833dab6-77a0-4abb-9bc6-3e00849efd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:52.944440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9833dab6-77a0-4abb-9bc6-3e00849efd5b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:52.945653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9833dab6-77a0-4abb-9bc6-3e00849efd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:53.011429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 596/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:10:53.281180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ac832-4a0d-4d34-826f-3c66d65dccbe None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:53.379211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:53.387170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ac832-4a0d-4d34-826f-3c66d65dccbe None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:53.420804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f051-53d0-473c-ba07-e5fef8b6683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:53.421397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f051-53d0-473c-ba07-e5fef8b6683f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:53.421764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f051-53d0-473c-ba07-e5fef8b6683f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:53.422029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f051-53d0-473c-ba07-e5fef8b6683f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:53.431875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4f051-53d0-473c-ba07-e5fef8b6683f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1fb4f051-53d0-473c-ba07-e5fef8b6683f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:53.436729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:53.437843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:10:53.438871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 592/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:10:53.443932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833dab6-77a0-4abb-9bc6-3e00849efd5b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:53.454177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:53.546014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833dab6-77a0-4abb-9bc6-3e00849efd5b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:53.579875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:53.580473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:53.580747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:53.581016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:53.581724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:53.582028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:53.583390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:53.592000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 597/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:10:53.598499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f051-53d0-473c-ba07-e5fef8b6683f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:53.700548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f051-53d0-473c-ba07-e5fef8b6683f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:53.736015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8a9c-8c6b-4e0a-827c-813d105d6026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:53.736636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8a9c-8c6b-4e0a-827c-813d105d6026 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:53.736915 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8a9c-8c6b-4e0a-827c-813d105d6026 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:53.737188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8a9c-8c6b-4e0a-827c-813d105d6026 None admin] PATH_INFO: `/v3/users/fb123dae274940efb01fd742e0cba527` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:53.738328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8a9c-8c6b-4e0a-827c-813d105d6026 None admin] RBAC: Authorizing `identity:get_user(user_id=fb123dae274940efb01fd742e0cba527)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:53.739749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8a9c-8c6b-4e0a-827c-813d105d6026 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:53.741332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 593/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:53 2022] GET /identity/v3/users/fb123dae274940efb01fd742e0cba527 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:53.747194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:53.816723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:53.850160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9ba09-5875-4671-84a5-4996665d018c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:53.883873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25f8ff-efa3-4e25-b5fe-aceb93b0deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:53.885038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25f8ff-efa3-4e25-b5fe-aceb93b0deae None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:53.885426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25f8ff-efa3-4e25-b5fe-aceb93b0deae None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:53.885730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25f8ff-efa3-4e25-b5fe-aceb93b0deae None admin] PATH_INFO: `/v3/projects/12905f53b35549e68ef2e259fb87e231` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:53.886844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25f8ff-efa3-4e25-b5fe-aceb93b0deae None admin] RBAC: Authorizing `identity:get_project(project_id=12905f53b35549e68ef2e259fb87e231)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:53.888270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25f8ff-efa3-4e25-b5fe-aceb93b0deae None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:53.889935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 598/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:53 2022] GET /identity/v3/projects/12905f53b35549e68ef2e259fb87e231 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:53.895903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8a9c-8c6b-4e0a-827c-813d105d6026 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:53.920528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:53.995186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8a9c-8c6b-4e0a-827c-813d105d6026 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:54.030080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddea4c1-f3d0-4d95-bcfb-393fab1877aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:54.030740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea4c1-f3d0-4d95-bcfb-393fab1877aa None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:54.031022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea4c1-f3d0-4d95-bcfb-393fab1877aa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:54.031299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea4c1-f3d0-4d95-bcfb-393fab1877aa None admin] PATH_INFO: `/v3/projects/12905f53b35549e68ef2e259fb87e231/users/fb123dae274940efb01fd742e0cba527/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:54.033190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddea4c1-f3d0-4d95-bcfb-393fab1877aa None admin] RBAC: Authorizing `identity:create_grant(project_id=12905f53b35549e68ef2e259fb87e231, user_id=fb123dae274940efb01fd742e0cba527, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:54.034676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddea4c1-f3d0-4d95-bcfb-393fab1877aa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:54.048008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 594/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:10:53 2022] PUT /identity/v3/projects/12905f53b35549e68ef2e259fb87e231/users/fb123dae274940efb01fd742e0cba527/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:10:56.201796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3350-2c58-42c3-b551-6c706700180d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:56.202324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3350-2c58-42c3-b551-6c706700180d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:56.202412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3350-2c58-42c3-b551-6c706700180d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:56.203697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 599/1193] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:10:56.208868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ed266-c786-4201-b461-f545c6f44027 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:56.209266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ed266-c786-4201-b461-f545c6f44027 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:56.209417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ed266-c786-4201-b461-f545c6f44027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:56.227314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5b5ed266-c786-4201-b461-f545c6f44027 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:10:56.228652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5b5ed266-c786-4201-b461-f545c6f44027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:10:56.296205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 595/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:10:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:10:56.576371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3350-2c58-42c3-b551-6c706700180d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:56.691457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3350-2c58-42c3-b551-6c706700180d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:56.723897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f089e-aa39-4ee9-8377-83981c9e0fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:56.724514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f089e-aa39-4ee9-8377-83981c9e0fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:56.724793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f089e-aa39-4ee9-8377-83981c9e0fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:56.725064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f089e-aa39-4ee9-8377-83981c9e0fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:56.732246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:56.736177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f089e-aa39-4ee9-8377-83981c9e0fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-578f089e-aa39-4ee9-8377-83981c9e0fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:10:56.741107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:10:56.742237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:10:56.743101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 600/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:10:56.748875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ed266-c786-4201-b461-f545c6f44027 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:56.762603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:56.847177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ed266-c786-4201-b461-f545c6f44027 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:56.880073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:56.880655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:56.880934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:56.881204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:56.881887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:56.882189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:56.883548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:56.891374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 596/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:56.897616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f089e-aa39-4ee9-8377-83981c9e0fc1 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:57.022801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f089e-aa39-4ee9-8377-83981c9e0fc1 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:57.058704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc8684-45bd-4512-896a-9a857e7626f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:57.059351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8684-45bd-4512-896a-9a857e7626f6 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:57.059627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8684-45bd-4512-896a-9a857e7626f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:57.059897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8684-45bd-4512-896a-9a857e7626f6 None admin] PATH_INFO: `/v3/users/fb123dae274940efb01fd742e0cba527` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:57.061044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc8684-45bd-4512-896a-9a857e7626f6 None admin] RBAC: Authorizing `identity:get_user(user_id=fb123dae274940efb01fd742e0cba527)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:57.062508 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc8684-45bd-4512-896a-9a857e7626f6 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:57.064110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 601/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Oct 6 12:10:56 2022] GET /identity/v3/users/fb123dae274940efb01fd742e0cba527 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:57.070208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:57.152408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:57.177986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa2df-c830-4192-baf9-b785f01acc45 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:57.211991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d06da-1651-4a64-bb09-d38551eee1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:57.213515 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d06da-1651-4a64-bb09-d38551eee1bb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:57.213515 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d06da-1651-4a64-bb09-d38551eee1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:57.213733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d06da-1651-4a64-bb09-d38551eee1bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:57.286456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d06da-1651-4a64-bb09-d38551eee1bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:57.287903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d06da-1651-4a64-bb09-d38551eee1bb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:57.361748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:57.387635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 597/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:10:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:10:57.393561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc8684-45bd-4512-896a-9a857e7626f6 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:57.458103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:10:57.493005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc8684-45bd-4512-896a-9a857e7626f6 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:57.528038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ef19a-07b3-4bc9-9553-3541a153abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:57.528690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef19a-07b3-4bc9-9553-3541a153abf1 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:57.528970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef19a-07b3-4bc9-9553-3541a153abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:57.529242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef19a-07b3-4bc9-9553-3541a153abf1 None admin] PATH_INFO: `/v3/projects/12905f53b35549e68ef2e259fb87e231` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:57.530383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ef19a-07b3-4bc9-9553-3541a153abf1 None admin] RBAC: Authorizing `identity:get_project(project_id=12905f53b35549e68ef2e259fb87e231)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:57.531820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ef19a-07b3-4bc9-9553-3541a153abf1 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:57.533453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 602/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Oct 6 12:10:57 2022] GET /identity/v3/projects/12905f53b35549e68ef2e259fb87e231 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:10:57.539697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d06da-1651-4a64-bb09-d38551eee1bb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:10:57.638826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d06da-1651-4a64-bb09-d38551eee1bb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:10:57.672750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336aa9e-f7bd-4e4c-b215-c4948f8082bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:10:57.673351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aa9e-f7bd-4e4c-b215-c4948f8082bf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:10:57.673672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aa9e-f7bd-4e4c-b215-c4948f8082bf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:10:57.673946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aa9e-f7bd-4e4c-b215-c4948f8082bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:10:57.674668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336aa9e-f7bd-4e4c-b215-c4948f8082bf None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12905f53b35549e68ef2e259fb87e231, user.id=fb123dae274940efb01fd742e0cba527) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:10:57.674976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336aa9e-f7bd-4e4c-b215-c4948f8082bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:10:57.676382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336aa9e-f7bd-4e4c-b215-c4948f8082bf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:10:57.682936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 598/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:10:57 2022] GET /identity/v3/role_assignments?user.id=fb123dae274940efb01fd742e0cba527&scope.project.id=12905f53b35549e68ef2e259fb87e231&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:11:07.523223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=33 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:11:07.679624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:11:55.274418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497251-f15a-47c8-992a-ec822f255686 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:55.275219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497251-f15a-47c8-992a-ec822f255686 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:55.275219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497251-f15a-47c8-992a-ec822f255686 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:55.276565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 603/1201] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:11:55.282122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ffbe-f8d5-4f65-b0a4-3eb1acaa5479 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:55.282891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ffbe-f8d5-4f65-b0a4-3eb1acaa5479 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:55.282891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ffbe-f8d5-4f65-b0a4-3eb1acaa5479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:55.310997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eae7ffbe-f8d5-4f65-b0a4-3eb1acaa5479 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:11:55.312237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eae7ffbe-f8d5-4f65-b0a4-3eb1acaa5479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:11:55.413120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 599/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:11:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:11:55.689252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35497251-f15a-47c8-992a-ec822f255686 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:11:55.861817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35497251-f15a-47c8-992a-ec822f255686 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:11:55.910826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:11:55.911776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:55.912063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:55.912332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:55.924504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:11:55.926859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:11:55.948504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:11:55.949688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:11:55.951287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:11:55.951287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:11:55.951287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:11:55.951287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 604/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:11:55.956152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ffbe-f8d5-4f65-b0a4-3eb1acaa5479 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:11:56.120448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ffbe-f8d5-4f65-b0a4-3eb1acaa5479 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:11:56.153018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:11:56.162815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14817dd-34fe-4454-9e49-9c9cdac8e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:11:56.163445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14817dd-34fe-4454-9e49-9c9cdac8e4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:56.163774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14817dd-34fe-4454-9e49-9c9cdac8e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:56.163999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14817dd-34fe-4454-9e49-9c9cdac8e4e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:56.164664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14817dd-34fe-4454-9e49-9c9cdac8e4e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:11:56.164970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14817dd-34fe-4454-9e49-9c9cdac8e4e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:11:56.166389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14817dd-34fe-4454-9e49-9c9cdac8e4e5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:11:56.180059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 600/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:11:56.185731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:11:56.250088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:11:56.312956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1f9f1-4356-439d-bc61-8da412426e29 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:11:56.361814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05ad85-f9ec-40b5-a38e-4b4b53cc78e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:11:56.362427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ad85-f9ec-40b5-a38e-4b4b53cc78e3 None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:56.362707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ad85-f9ec-40b5-a38e-4b4b53cc78e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:56.362977 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ad85-f9ec-40b5-a38e-4b4b53cc78e3 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:56.364196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05ad85-f9ec-40b5-a38e-4b4b53cc78e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:11:56.365768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05ad85-f9ec-40b5-a38e-4b4b53cc78e3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:11:56.401566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 605/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Oct 6 12:11:56 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:11:58.907637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c591ef-9ce0-4372-a05d-c6e1dba4933c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:58.908239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c591ef-9ce0-4372-a05d-c6e1dba4933c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:58.908239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c591ef-9ce0-4372-a05d-c6e1dba4933c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:58.910099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 601/1206] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:11:58.915969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b8428-1fde-4465-aa9c-508fd3ef5ee4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:58.916857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b8428-1fde-4465-aa9c-508fd3ef5ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:58.916857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b8428-1fde-4465-aa9c-508fd3ef5ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:58.941636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7d2b8428-1fde-4465-aa9c-508fd3ef5ee4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:11:58.942919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7d2b8428-1fde-4465-aa9c-508fd3ef5ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:11:59.023897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 606/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:11:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:11:59.322492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c591ef-9ce0-4372-a05d-c6e1dba4933c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:11:59.450643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c591ef-9ce0-4372-a05d-c6e1dba4933c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:11:59.496763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541cbb-3f2c-4a9a-a130-a3d0abc14fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:11:59.496763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541cbb-3f2c-4a9a-a130-a3d0abc14fdb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:59.496763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541cbb-3f2c-4a9a-a130-a3d0abc14fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:59.496763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71541cbb-3f2c-4a9a-a130-a3d0abc14fdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:59.509971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71541cbb-3f2c-4a9a-a130-a3d0abc14fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-71541cbb-3f2c-4a9a-a130-a3d0abc14fdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:11:59.515392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:11:59.516585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:11:59.517747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 602/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:11:59.525562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b8428-1fde-4465-aa9c-508fd3ef5ee4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:11:59.584599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:11:59.673521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b8428-1fde-4465-aa9c-508fd3ef5ee4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:11:59.719877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:11:59.720533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:59.720850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:59.721156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:59.721867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:11:59.722748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:11:59.724391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:11:59.734819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 607/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:11:59.741713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541cbb-3f2c-4a9a-a130-a3d0abc14fdb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:11:59.799181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:11:59.857192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71541cbb-3f2c-4a9a-a130-a3d0abc14fdb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:11:59.894777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:11:59.895498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:11:59.896107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:11:59.896107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:11:59.907726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:11:59.909396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:11:59.925097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:11:59.928232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:11:59.929773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:11:59.929773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:11:59.929773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:11:59.929773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 603/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:11:59.933454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:00.075056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:00.078527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed6e4d-b1a6-4055-9010-208ecfd4de1b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:00.119582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:00.120250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:00.120619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:00.120987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:00.121800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:00.122206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:00.123756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:00.142993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 608/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:00.144772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:00.258558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc5ec8-68c7-4add-9f75-321d0d3c26f5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:00.260236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:00.301840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:00.302650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:00.303034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:00.303434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:00.313311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:00.314982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:12:00.330318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:00.331501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:00.337860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 604/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:00.340285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:00.475817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bca61-3e19-4e0c-b3bb-b26f18c1c6e3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:00.523824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:00.528038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:00.528038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:00.528038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:00.528038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:00.528038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:00.528038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:00.547280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 609/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Oct 6 12:12:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:00.553822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:00.680153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00606-53b3-4f8b-9f43-e1236bd66359 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:00.727485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018f0f-1a78-4e3a-99d9-927d6a92d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:00.728645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018f0f-1a78-4e3a-99d9-927d6a92d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:00.728947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018f0f-1a78-4e3a-99d9-927d6a92d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:00.729269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018f0f-1a78-4e3a-99d9-927d6a92d4b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:00.772024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:00.817645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd018f0f-1a78-4e3a-99d9-927d6a92d4b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:00.819267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd018f0f-1a78-4e3a-99d9-927d6a92d4b8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:00.946668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 605/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:12:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:12:00.955784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:00.980946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:01.078207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a7376-4b1b-4925-b23d-ee1e43c7a649 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:01.121150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:01.121998 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:01.122282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:01.124665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:01.141025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:01.143052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:01.164624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:01.165753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:01.171957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:01.171957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:01.171957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:01.171957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 610/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:01.172243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018f0f-1a78-4e3a-99d9-927d6a92d4b8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:01.265242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:01.312368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018f0f-1a78-4e3a-99d9-927d6a92d4b8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:01.351119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:01.351834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:01.352116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:01.352414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:01.353206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:01.353674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:01.355229 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:01.372101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 606/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:01.380824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:01.474278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:01.512704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9800f9-5ed8-481d-ad75-51fc3a0c6d7b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:01.559475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:01.560066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:01.560376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:01.560692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:01.569733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:01.571415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:12:01.586626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:01.592798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:01.593964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 611/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:12:01.594558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:01.731799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e74bf9-6503-4aea-b7b5-10b82cac1e6d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:01.764048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:01.779888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874e773-9570-4b99-867a-a196efb727ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:01.780549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e773-9570-4b99-867a-a196efb727ac None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:01.780834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e773-9570-4b99-867a-a196efb727ac None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:01.781110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e773-9570-4b99-867a-a196efb727ac None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:01.781848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874e773-9570-4b99-867a-a196efb727ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:01.782294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874e773-9570-4b99-867a-a196efb727ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:01.783982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874e773-9570-4b99-867a-a196efb727ac None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:01.798305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 607/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:01.804965 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:01.929559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ba34-7431-4810-be4a-6d854096ab56 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:01.965166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:01.974920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391b7d5-f965-4eb7-b1be-d775b78ce595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:01.975735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391b7d5-f965-4eb7-b1be-d775b78ce595 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:01.976091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391b7d5-f965-4eb7-b1be-d775b78ce595 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:01.976436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391b7d5-f965-4eb7-b1be-d775b78ce595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:01.977338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391b7d5-f965-4eb7-b1be-d775b78ce595 None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=e3188514d47747c0ae22b9b35cf3c274) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:01.977725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391b7d5-f965-4eb7-b1be-d775b78ce595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:01.979328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391b7d5-f965-4eb7-b1be-d775b78ce595 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:01.991948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 612/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:12:01 2022] GET /identity/v3/role_assignments?user.id=e3188514d47747c0ae22b9b35cf3c274&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:04.236517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596396-05b2-42ab-883a-1f3a9e142274 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:04.237074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596396-05b2-42ab-883a-1f3a9e142274 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:04.237074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596396-05b2-42ab-883a-1f3a9e142274 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:04.238551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 608/1220] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:12:04.244156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241c60-9c03-4435-8736-1e77bcccdb78 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:04.244669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241c60-9c03-4435-8736-1e77bcccdb78 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:04.244775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241c60-9c03-4435-8736-1e77bcccdb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:04.264676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d7241c60-9c03-4435-8736-1e77bcccdb78 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:04.265924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d7241c60-9c03-4435-8736-1e77bcccdb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:04.348126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 613/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:12:04.640487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db596396-05b2-42ab-883a-1f3a9e142274 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:04.754061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db596396-05b2-42ab-883a-1f3a9e142274 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:04.807607 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410ea68-361b-483f-8a1f-53029016bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:04.808498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410ea68-361b-483f-8a1f-53029016bea9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:04.808948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410ea68-361b-483f-8a1f-53029016bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:04.809274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410ea68-361b-483f-8a1f-53029016bea9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:04.822256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410ea68-361b-483f-8a1f-53029016bea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d410ea68-361b-483f-8a1f-53029016bea9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:12:04.828168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:04.829411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:04.830561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 609/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:04.836525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241c60-9c03-4435-8736-1e77bcccdb78 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:04.946694 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241c60-9c03-4435-8736-1e77bcccdb78 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:04.981734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:04.997267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:04.997912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:04.998266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:04.998473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:04.999146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] RBAC: Adding query filter params (name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:04.999448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:05.000833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:05.010953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 614/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:05.016843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410ea68-361b-483f-8a1f-53029016bea9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:05.068337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:05.154470 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410ea68-361b-483f-8a1f-53029016bea9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:05.201002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:05.201560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:05.201863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:05.202141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:05.214488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:05.215942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:05.233175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:05.234265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:05.235161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:05.235161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:05.235161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:05.235161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 610/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:12:05.241473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:05.355361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262addda-6762-4e6d-bf7d-c75e15a8e14f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:05.397969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:05.398586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:05.398865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:05.399133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:05.400045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:05.400503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:05.401993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:05.416213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 615/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:05.422058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:05.572503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:05.581810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9da43b-98ed-4cbe-9bd4-8908e0e46381 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:05.619538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:05.620193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:05.620451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:05.620725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:05.630545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:05.632160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:12:05.644646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:05.645864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:05.646833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 611/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:12:05.652136 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:05.701421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:05.781811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4563e0-199d-432c-8f1d-7fcef73d56cf None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:05.820883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:05.821561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:05.821807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:05.822142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:05.822880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:05.823124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:05.824558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:05.844739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 616/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Oct 6 12:12:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:05.851268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:05.955720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566cff3-f1d1-4255-b15a-a009ec90495d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:05.999065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:05.999740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:06.000025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:06.000303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:06.012227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:06.014152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:06.029446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:06.031226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:06.032166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:06.032166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:06.032166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:06.032166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 612/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:06.037622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:06.168020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4ce2d-b045-4181-98ea-8efca130a5ec None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:06.170739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:06.211924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:06.212547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:06.212840 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:06.213178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:06.213801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:06.214180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:06.215491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:06.229033 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 617/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:06.235594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:06.246295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:06.359994 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55e3e-67d4-4593-93c2-6c5d9bae5be2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:06.401922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:06.402462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:06.402772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:06.403047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:06.413431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:06.415358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:12:06.428472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:06.429932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:06.431202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 613/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:06.436753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:06.563623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63bb6d-0816-4e5f-aee5-c1a28732d731 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:06.614081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f100941-ab0f-41af-b17f-c6a178e61765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:06.614081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100941-ab0f-41af-b17f-c6a178e61765 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:06.614766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100941-ab0f-41af-b17f-c6a178e61765 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:06.614766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100941-ab0f-41af-b17f-c6a178e61765 None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:06.615378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f100941-ab0f-41af-b17f-c6a178e61765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:06.615657 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f100941-ab0f-41af-b17f-c6a178e61765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:06.617215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f100941-ab0f-41af-b17f-c6a178e61765 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:06.631642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 618/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:06.637882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:06.726630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:06.770427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd20fc0-d2b8-4682-94b3-b777fbe101da None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:06.810418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9d2ac-f5ba-45f1-a7ea-b45f7b5d1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:06.811137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d2ac-f5ba-45f1-a7ea-b45f7b5d1af0 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:06.811455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d2ac-f5ba-45f1-a7ea-b45f7b5d1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:06.811785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9d2ac-f5ba-45f1-a7ea-b45f7b5d1af0 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/e3188514d47747c0ae22b9b35cf3c274/roles/473c27c2658941c492c7a8b45c37dddc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:06.828257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9d2ac-f5ba-45f1-a7ea-b45f7b5d1af0 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=e3188514d47747c0ae22b9b35cf3c274, role_id=473c27c2658941c492c7a8b45c37dddc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:06.829897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9d2ac-f5ba-45f1-a7ea-b45f7b5d1af0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:06.845125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 614/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:12:06 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/e3188514d47747c0ae22b9b35cf3c274/roles/473c27c2658941c492c7a8b45c37dddc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:12:09.303526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1bcf-b039-4f51-9627-a72f6727c017 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:09.304083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1bcf-b039-4f51-9627-a72f6727c017 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:09.304083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1bcf-b039-4f51-9627-a72f6727c017 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:09.305438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 619/1233] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:12:09.311496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d113877-99f7-4833-b208-710768fd4e40 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:09.311946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d113877-99f7-4833-b208-710768fd4e40 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:09.312095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d113877-99f7-4833-b208-710768fd4e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:09.333601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6d113877-99f7-4833-b208-710768fd4e40 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:09.334808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6d113877-99f7-4833-b208-710768fd4e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:09.412812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 615/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:12:09.734806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1bcf-b039-4f51-9627-a72f6727c017 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:09.761907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:09.850006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1bcf-b039-4f51-9627-a72f6727c017 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:09.903523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e4ee4-33ef-4659-aead-d87599947138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:09.904462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4ee4-33ef-4659-aead-d87599947138 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:09.904827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4ee4-33ef-4659-aead-d87599947138 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:09.905186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4ee4-33ef-4659-aead-d87599947138 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:09.921883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e4ee4-33ef-4659-aead-d87599947138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-450e4ee4-33ef-4659-aead-d87599947138 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:12:09.929505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:09.930579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:09.931432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 620/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Oct 6 12:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:09.939308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d113877-99f7-4833-b208-710768fd4e40 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:09.991549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:10.056160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d113877-99f7-4833-b208-710768fd4e40 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:10.092802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:10.093410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:10.093728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:10.094008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:10.094871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:10.095159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:10.096603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:10.105365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 616/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Oct 6 12:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:12:10.111247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e4ee4-33ef-4659-aead-d87599947138 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:10.238908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:10.260320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e4ee4-33ef-4659-aead-d87599947138 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:10.307565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:10.308397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:10.308659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:10.308935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:10.322691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:10.324170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:10.340753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:10.348896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:10.350224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:10.350224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:10.350224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:10.350224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 621/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:10.350537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:10.487635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0690-2073-4994-b54b-d41a0e720545 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:10.501434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:10.532397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:10.532940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:10.533235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:10.534087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:10.534862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:10.535148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:10.536521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:10.556145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 617/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:10.558318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:10.679586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8ce8b-4458-4667-8ea9-0a6edbc2647b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:10.719995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:10.720714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:10.721035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:10.721288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:10.725045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:10.731937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:10.733942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:12:10.754979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:10.756393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:10.757595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:10.762550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 622/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:12:10.763844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:10.873267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06915f4-0aba-48cc-be2f-3f02b0ce9ece None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:10.909477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:10.910240 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:10.910626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:10.911001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:10.911907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:10.912388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:10.914091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:10.931819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 618/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Oct 6 12:12:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:12:10.938049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:11.054189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286dfe1-789e-47ed-af6f-af7fa5cda1b2 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:11.087781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12f05a-dc5f-4112-b888-cffde15f269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:11.088382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f05a-dc5f-4112-b888-cffde15f269f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:11.088656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f05a-dc5f-4112-b888-cffde15f269f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:11.088925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f05a-dc5f-4112-b888-cffde15f269f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:11.158239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:11.168035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12f05a-dc5f-4112-b888-cffde15f269f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:11.169774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12f05a-dc5f-4112-b888-cffde15f269f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:11.298535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 623/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:12:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:12:11.307821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:11.345305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:11.431008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68703ca8-b89e-4f01-b0f6-0648b753ebb7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:11.471875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:11.472653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:11.472976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:11.473273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:11.486085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:11.488099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:11.505392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:11.506627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:11.507920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:11.507920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:11.507920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:11.507920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 619/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:11.512637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12f05a-dc5f-4112-b888-cffde15f269f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:11.626640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:11.633546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12f05a-dc5f-4112-b888-cffde15f269f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:11.672930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:11.673669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:11.673953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:11.674939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:11.675728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:11.676033 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:11.677402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:11.690036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 624/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:11.696540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:11.792520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:11.816460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc79f7-0410-437d-a2a4-465345e39cc9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:11.852951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:11.853681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:11.853965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:11.854378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:11.862275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:11.863734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:12:11.875360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:11.876485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:11.877674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 620/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:11.882638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:11.998072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629848e-255c-4cdd-8ef2-ff23cc945b0b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:12.034737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad320c3-9f87-45e2-82b7-80ff99f5703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:12.035493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad320c3-9f87-45e2-82b7-80ff99f5703f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:12.035796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad320c3-9f87-45e2-82b7-80ff99f5703f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:12.036094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad320c3-9f87-45e2-82b7-80ff99f5703f None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:12.036807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad320c3-9f87-45e2-82b7-80ff99f5703f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:12.037109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad320c3-9f87-45e2-82b7-80ff99f5703f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:12.038670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad320c3-9f87-45e2-82b7-80ff99f5703f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:12.051945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 625/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:12.058342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:12.177027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b606-9a49-48a2-9733-821bef87d0c3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:12.215018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4fb5-d7df-48ff-8258-4d7aeaf8ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:12.215630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4fb5-d7df-48ff-8258-4d7aeaf8ca7b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:12.215917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4fb5-d7df-48ff-8258-4d7aeaf8ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:12.216202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4fb5-d7df-48ff-8258-4d7aeaf8ca7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:12.216989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d4fb5-d7df-48ff-8258-4d7aeaf8ca7b None admin] RBAC: Adding query filter params (role.id=473c27c2658941c492c7a8b45c37dddc, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=e3188514d47747c0ae22b9b35cf3c274) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:12.217626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d4fb5-d7df-48ff-8258-4d7aeaf8ca7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:12.219460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d4fb5-d7df-48ff-8258-4d7aeaf8ca7b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:12.235317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 621/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:12:12 2022] GET /identity/v3/role_assignments?user.id=e3188514d47747c0ae22b9b35cf3c274&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=473c27c2658941c492c7a8b45c37dddc => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:14.753181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ffadb-e615-4e79-aff5-bd9d6f943ee7 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:14.753819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ffadb-e615-4e79-aff5-bd9d6f943ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:14.753819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ffadb-e615-4e79-aff5-bd9d6f943ee7 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:14.755089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 626/1247] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:12:14.760813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e499-1388-4d9b-ae9b-d048a671e5e9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:14.761270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e499-1388-4d9b-ae9b-d048a671e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:14.761374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e499-1388-4d9b-ae9b-d048a671e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:14.769013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:14.781500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-26e7e499-1388-4d9b-ae9b-d048a671e5e9 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:14.782714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26e7e499-1388-4d9b-ae9b-d048a671e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:14.859989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 622/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:12:15.144495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ffadb-e615-4e79-aff5-bd9d6f943ee7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:15.163201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:15.250736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ffadb-e615-4e79-aff5-bd9d6f943ee7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:15.289020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664142-2f2c-420d-ba24-676dd3808a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:15.289895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664142-2f2c-420d-ba24-676dd3808a5f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:15.290215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664142-2f2c-420d-ba24-676dd3808a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:15.290564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664142-2f2c-420d-ba24-676dd3808a5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:15.303329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a664142-2f2c-420d-ba24-676dd3808a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-2a664142-2f2c-420d-ba24-676dd3808a5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:12:15.309206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:15.310309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:15.311228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 627/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:12:15.317190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e499-1388-4d9b-ae9b-d048a671e5e9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:15.424839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e499-1388-4d9b-ae9b-d048a671e5e9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:15.474748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:15.483420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:15.484248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:15.484569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:15.484990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:15.486144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:15.486710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:15.488913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:15.498994 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 623/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:15.507656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664142-2f2c-420d-ba24-676dd3808a5f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:15.595242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:15.622691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664142-2f2c-420d-ba24-676dd3808a5f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:15.660256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:15.660895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:15.661175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:15.661442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:15.672362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:15.674080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:15.692543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:15.693842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:15.695034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:15.695034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:15.695034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:15.695034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 628/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:15.699824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:15.807693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed79ab-685e-4173-9690-d6ff5e3f8086 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:15.844014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:15.844628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:15.844911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:15.845185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:15.846461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:15.846461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:15.847621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:15.859825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 624/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:15.866954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:15.977888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e327d-c4e0-45bb-bf58-a3844d84f8c8 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:16.013367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:16.023202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:16.023842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:16.024124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:16.024390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:16.032894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:16.034603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:12:16.047297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:16.048462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:16.050719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 629/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:16.055538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:16.122771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:16.171067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3978a3d-6319-4880-8b9d-d62d520a48c2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:16.209142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:16.209782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:16.210065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:16.210330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:16.211075 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:16.211387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:16.212881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:16.233614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 625/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Oct 6 12:12:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:12:16.240454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:16.350111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e8f2-280e-4859-8f63-29bb9c480145 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:16.385463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e244-f68f-4bc2-98d3-ba21e0357ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:16.386106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e244-f68f-4bc2-98d3-ba21e0357ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:16.386388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e244-f68f-4bc2-98d3-ba21e0357ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:16.386708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e244-f68f-4bc2-98d3-ba21e0357ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:16.446544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:16.461300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3e244-f68f-4bc2-98d3-ba21e0357ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:16.462831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3e244-f68f-4bc2-98d3-ba21e0357ef3 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:16.569727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 630/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:12:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:12:16.575702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:16.694289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c401ff-c6d3-4f87-86fd-73395b05943f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:16.708562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:16.730986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:16.731692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:16.731978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:16.732345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:16.743751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:16.745221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:16.760892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:16.762166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:16.763435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:16.763435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:16.763435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:16.763435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 626/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:16.768260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e244-f68f-4bc2-98d3-ba21e0357ef3 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:16.866660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:16.880705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e244-f68f-4bc2-98d3-ba21e0357ef3 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:16.917109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:16.917760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:16.918041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:16.918315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:16.919000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:16.919274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:16.920656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:16.934061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 631/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:16.940389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:17.061695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42d6d9-d640-4a46-8bfe-4ed75f2b7e6a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:17.100080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:17.100734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:17.101015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:17.101287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:17.108779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:17.110404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:12:17.123078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:17.124215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:17.125306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 627/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:12:17.130883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:17.242051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d667-fc89-452d-80de-8a303a413f6f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:17.279952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223fb55-37e1-4626-b413-d004860f1f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:17.280580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223fb55-37e1-4626-b413-d004860f1f3d None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:17.280857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223fb55-37e1-4626-b413-d004860f1f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:17.281126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223fb55-37e1-4626-b413-d004860f1f3d None admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:17.281989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223fb55-37e1-4626-b413-d004860f1f3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:17.282296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223fb55-37e1-4626-b413-d004860f1f3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:17.284532 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223fb55-37e1-4626-b413-d004860f1f3d None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:17.298156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 632/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:17.305205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:17.333365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:17.415336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86060a-304e-4068-8d36-afc716066317 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:17.452739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45ad20-d783-4f2d-9a93-db0f6101c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:17.453362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ad20-d783-4f2d-9a93-db0f6101c03e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:17.453652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ad20-d783-4f2d-9a93-db0f6101c03e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:17.453933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ad20-d783-4f2d-9a93-db0f6101c03e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:17.454679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ad20-d783-4f2d-9a93-db0f6101c03e None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=e3188514d47747c0ae22b9b35cf3c274) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:17.455493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ad20-d783-4f2d-9a93-db0f6101c03e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:17.457169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ad20-d783-4f2d-9a93-db0f6101c03e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:17.463826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 628/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:12:17 2022] GET /identity/v3/role_assignments?user.id=e3188514d47747c0ae22b9b35cf3c274&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:19.624886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e350f5-ed53-4621-a6aa-13a5e3da6c0f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:19.625390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e350f5-ed53-4621-a6aa-13a5e3da6c0f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:19.625390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e350f5-ed53-4621-a6aa-13a5e3da6c0f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:19.626843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 633/1261] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:12:19.632082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86a74-3873-412f-a167-ccf79f027199 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:19.632558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86a74-3873-412f-a167-ccf79f027199 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:19.632666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86a74-3873-412f-a167-ccf79f027199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:19.651108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a8d86a74-3873-412f-a167-ccf79f027199 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:19.652271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a8d86a74-3873-412f-a167-ccf79f027199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:19.723830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 629/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 06 12:12:19.996391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e350f5-ed53-4621-a6aa-13a5e3da6c0f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:20.007773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:20.114955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e350f5-ed53-4621-a6aa-13a5e3da6c0f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:20.150791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237080d-6a97-4dec-80f2-3e09da16fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:20.151420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237080d-6a97-4dec-80f2-3e09da16fcbd None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:20.151698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237080d-6a97-4dec-80f2-3e09da16fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:20.151968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237080d-6a97-4dec-80f2-3e09da16fcbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:20.162016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237080d-6a97-4dec-80f2-3e09da16fcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7237080d-6a97-4dec-80f2-3e09da16fcbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:12:20.166797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:20.167904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:20.168779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 634/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:20.174521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86a74-3873-412f-a167-ccf79f027199 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:20.193892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:20.279442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86a74-3873-412f-a167-ccf79f027199 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:20.312857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:20.313451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:20.313759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:20.314734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:20.315403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:20.315706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:20.317066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:20.325332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 630/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:12:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:20.335177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237080d-6a97-4dec-80f2-3e09da16fcbd None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:20.407603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:20.452371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237080d-6a97-4dec-80f2-3e09da16fcbd None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:20.495640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:20.496366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:20.496715 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:20.496942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:20.509221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:20.511082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:20.529769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:20.530995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:20.532151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:20.532151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:20.532151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:20.532151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 635/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:20.537397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:20.616535 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:20.635162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32187d4b-00d8-423a-988f-664cec0a908c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:20.668084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:20.668688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:20.668976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:20.669253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:20.669933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:20.670241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:20.671604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:20.685866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 631/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:20.691777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:20.800007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeeec6-d7b5-4a66-a784-33206593db5b None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:20.821279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:20.842439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:20.843068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:20.843345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:20.843611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:20.852027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:20.853446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:12:20.865007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:20.866139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:20.867104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 636/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:20.871923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:20.967550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862d1a5-2fca-4913-8eb7-b3652a22f651 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:21.001665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:21.002337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:21.002621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:21.002895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:21.003620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:21.003927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:21.005350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:21.013810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:21.023130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 632/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Oct 6 12:12:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:21.028916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:21.150122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418f75-8135-4584-b1af-00a1d4447b8f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:21.185285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:21.185941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:21.186221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:21.186495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:21.196847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:21.198381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:21.212986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:21.214273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:21.215216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:21.215216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:21.215216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:21.215216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 637/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:21.222053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:21.324210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf85441-d6d9-4f77-b2b8-afc736332007 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:21.364092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:21.364804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:21.365098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:21.365372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:21.366187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:21.366538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:21.368431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:21.382246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 633/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:21.388226 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:21.421964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:21.513847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d0ad6-b4a8-4bd0-91fe-e25503fcb439 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:21.556701 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:21.557334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:21.557647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:21.557926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:21.565796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:21.567251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:12:21.578789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:21.580693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:21.581941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 638/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:21.587133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:21.645487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:21.685962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee32e-f0ec-460b-8682-52fb747cdb95 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:21.718678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06984f7f-ef7d-498f-9de2-e4f987b1c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:21.719270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06984f7f-ef7d-498f-9de2-e4f987b1c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:21.719549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06984f7f-ef7d-498f-9de2-e4f987b1c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:21.719820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06984f7f-ef7d-498f-9de2-e4f987b1c4a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:21.720619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06984f7f-ef7d-498f-9de2-e4f987b1c4a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:21.720883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06984f7f-ef7d-498f-9de2-e4f987b1c4a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:21.722319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06984f7f-ef7d-498f-9de2-e4f987b1c4a7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:21.733943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 634/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:21.741437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:21.836109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:21.845512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9415f-3717-4753-9c09-f760a5e3af9f None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:21.884957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdd4a2-8049-4591-a0e9-501548facf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:21.885641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd4a2-8049-4591-a0e9-501548facf73 None admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:21.885920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd4a2-8049-4591-a0e9-501548facf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:21.886191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd4a2-8049-4591-a0e9-501548facf73 None admin] PATH_INFO: `/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/e3188514d47747c0ae22b9b35cf3c274/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:21.888070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdd4a2-8049-4591-a0e9-501548facf73 None admin] RBAC: Authorizing `identity:create_grant(project_id=12c8d742de3a4bacaa90d9b54a952608, user_id=e3188514d47747c0ae22b9b35cf3c274, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:21.889495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdd4a2-8049-4591-a0e9-501548facf73 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:21.902993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 639/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Oct 6 12:12:21 2022] PUT /identity/v3/projects/12c8d742de3a4bacaa90d9b54a952608/users/e3188514d47747c0ae22b9b35cf3c274/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:12:24.105522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1681-0cac-483a-a09b-2db220bcedda None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:24.106087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1681-0cac-483a-a09b-2db220bcedda None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:24.106087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1681-0cac-483a-a09b-2db220bcedda None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:24.107436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 635/1274] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:12:24.113630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab92cc-74ad-4b0a-bcd9-cd24eab047e7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:24.114108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab92cc-74ad-4b0a-bcd9-cd24eab047e7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:24.114199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab92cc-74ad-4b0a-bcd9-cd24eab047e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:24.134413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d2ab92cc-74ad-4b0a-bcd9-cd24eab047e7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:24.135606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d2ab92cc-74ad-4b0a-bcd9-cd24eab047e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:24.205351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 640/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:12:24.488292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d1681-0cac-483a-a09b-2db220bcedda None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:24.601452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d1681-0cac-483a-a09b-2db220bcedda None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:24.619689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:24.636732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2a86-cccf-40c4-883e-1caa34eb1d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:24.637364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2a86-cccf-40c4-883e-1caa34eb1d96 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:24.637677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2a86-cccf-40c4-883e-1caa34eb1d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:24.637954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2a86-cccf-40c4-883e-1caa34eb1d96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:24.649013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2a86-cccf-40c4-883e-1caa34eb1d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-801b2a86-cccf-40c4-883e-1caa34eb1d96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 06 12:12:24.653858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:24.655260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:24.656255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 636/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Oct 6 12:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:24.661947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab92cc-74ad-4b0a-bcd9-cd24eab047e7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:24.750132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:24.772141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab92cc-74ad-4b0a-bcd9-cd24eab047e7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:24.807455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:24.808060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:24.808334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:24.808601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:24.809262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:24.809580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:24.810944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:24.820375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 641/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Oct 6 12:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:24.826605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2a86-cccf-40c4-883e-1caa34eb1d96 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:24.940375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2a86-cccf-40c4-883e-1caa34eb1d96 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:24.975107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:24.975735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:24.976073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:24.976351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:24.996537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:24.998044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:25.015246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:25.016692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:25.017649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:25.017649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:25.017649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:25.017649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 637/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:25.022644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:25.123643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fe34-cecd-4362-8a00-2d61cf274ebb None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:25.168158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:25.168768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:25.169044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:25.169315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:25.169990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:25.170288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:25.171651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:25.184486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 642/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:25.190524 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:25.221312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:25.292962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e220d-74fb-47f6-903e-d1c8fdca65f7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:25.327310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:25.327934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:25.328213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:25.328481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:25.336417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:25.337870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 06 12:12:25.349646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:25.350982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:25.352276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 638/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:25.356877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:25.362583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:25.470811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5e8b8-8132-4415-9fd9-e10a25f6702c None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:25.505407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:25.506040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:25.506318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:25.506588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:25.507315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:25.507615 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:25.509050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:25.527661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 643/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Oct 6 12:12:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:25.534190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:25.631364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:25.641315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89f8d-84ee-47e9-89aa-db58e006a46a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:25.679886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daac33-2bf1-4f72-b33e-cfc518db2691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:25.680504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daac33-2bf1-4f72-b33e-cfc518db2691 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:25.680791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daac33-2bf1-4f72-b33e-cfc518db2691 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:25.681070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daac33-2bf1-4f72-b33e-cfc518db2691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:25.758436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daac33-2bf1-4f72-b33e-cfc518db2691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:25.759893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daac33-2bf1-4f72-b33e-cfc518db2691 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:25.851493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:25.863528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 639/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Oct 6 12:12:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 06 12:12:25.869584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:25.943559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:25.983627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394cdff-8c42-4153-ad63-fe1fb657da90 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:26.018907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:26.019537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:26.019814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:26.020082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:26.030673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:26.032118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 06 12:12:26.047048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:26.048621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 06 12:12:26.049548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 06 12:12:26.049548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 06 12:12:26.049548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:26.049548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 644/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 06 12:12:26.054335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daac33-2bf1-4f72-b33e-cfc518db2691 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:26.159131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daac33-2bf1-4f72-b33e-cfc518db2691 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:26.194661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:26.195308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:26.195459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:26.195736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:26.196395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:26.196700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:26.198116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:26.210565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 640/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Oct 6 12:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:26.216328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:26.318423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7eba-0690-4788-b529-dc5b721b8d79 None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:26.333407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:26.355078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:26.355710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:26.355991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:26.356265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:26.363185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:26.364624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 06 12:12:26.376076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:26.377313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: ERROR keystone.server.flask.application Oct 06 12:12:26.378858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 645/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Oct 6 12:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:26.383423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:26.435703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:26.488462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133a9bf-745f-40d0-9a52-2dc702227511 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:26.522638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e753e-deee-4e43-8b15-d63a3768a18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:26.523245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e753e-deee-4e43-8b15-d63a3768a18d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:26.523525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e753e-deee-4e43-8b15-d63a3768a18d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:26.523799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e753e-deee-4e43-8b15-d63a3768a18d None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:26.524496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e753e-deee-4e43-8b15-d63a3768a18d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:26.524802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e753e-deee-4e43-8b15-d63a3768a18d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:26.526248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e753e-deee-4e43-8b15-d63a3768a18d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:26.539427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 641/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Oct 6 12:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:26.548415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:26.651117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1e3c9-8c33-44b6-bf07-c77ed8ca87df None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:26.685013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b027-e209-4d42-a78e-8eeae87ae53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:26.685634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b027-e209-4d42-a78e-8eeae87ae53e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:26.685912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b027-e209-4d42-a78e-8eeae87ae53e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:26.686179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b027-e209-4d42-a78e-8eeae87ae53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:26.686892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b027-e209-4d42-a78e-8eeae87ae53e None admin] RBAC: Adding query filter params (role.id=818fd3697c3b46ce81096e2fa76e90d4, scope.project.id=12c8d742de3a4bacaa90d9b54a952608, user.id=e3188514d47747c0ae22b9b35cf3c274) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:26.687194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b027-e209-4d42-a78e-8eeae87ae53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:26.689106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b027-e209-4d42-a78e-8eeae87ae53e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:26.694884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 646/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Oct 6 12:12:26 2022] GET /identity/v3/role_assignments?user.id=e3188514d47747c0ae22b9b35cf3c274&scope.project.id=12c8d742de3a4bacaa90d9b54a952608&role.id=818fd3697c3b46ce81096e2fa76e90d4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:28.900978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471732-1256-4156-bbd2-8d5bcb0054d0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:28.901584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471732-1256-4156-bbd2-8d5bcb0054d0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:28.901584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e471732-1256-4156-bbd2-8d5bcb0054d0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:28.903110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 642/1288] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:12:28.908437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bdd33-63e9-432c-89c3-ea5bcfc5637f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:28.908854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bdd33-63e9-432c-89c3-ea5bcfc5637f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:28.909041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bdd33-63e9-432c-89c3-ea5bcfc5637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:28.926939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-690bdd33-63e9-432c-89c3-ea5bcfc5637f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:28.928111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-690bdd33-63e9-432c-89c3-ea5bcfc5637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:28.958417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:28.998639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 647/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:12:29.271699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e471732-1256-4156-bbd2-8d5bcb0054d0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:29.372625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e471732-1256-4156-bbd2-8d5bcb0054d0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:29.384299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:29.407986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:29.408620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:29.408902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:29.409174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:29.409792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:29.411159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:29.419908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:29.421164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:29.423225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 643/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:12:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:29.428343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bdd33-63e9-432c-89c3-ea5bcfc5637f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:29.548043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bdd33-63e9-432c-89c3-ea5bcfc5637f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:29.582337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b4b42-f22f-4021-8280-bfff68eaae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:29.582938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b4b42-f22f-4021-8280-bfff68eaae13 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:29.583215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b4b42-f22f-4021-8280-bfff68eaae13 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:29.583487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b4b42-f22f-4021-8280-bfff68eaae13 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:29.584134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b4b42-f22f-4021-8280-bfff68eaae13 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:29.584435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b4b42-f22f-4021-8280-bfff68eaae13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:29.585829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b4b42-f22f-4021-8280-bfff68eaae13 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:29.590545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 648/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Oct 6 12:12:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:29.596868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:29.694045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84efa1-403d-4442-b9ab-e25585d7794d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:29.727184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fbced-6480-4d36-b6e7-04c3a26f4d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:29.727785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fbced-6480-4d36-b6e7-04c3a26f4d2f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:29.728063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fbced-6480-4d36-b6e7-04c3a26f4d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:29.728333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fbced-6480-4d36-b6e7-04c3a26f4d2f None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:29.728961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fbced-6480-4d36-b6e7-04c3a26f4d2f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:29.729260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fbced-6480-4d36-b6e7-04c3a26f4d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:29.730637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fbced-6480-4d36-b6e7-04c3a26f4d2f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:29.735856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 644/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Oct 6 12:12:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:32.152429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de75cd-ed30-4b07-a959-d4bdaac78fa9 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:32.152930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de75cd-ed30-4b07-a959-d4bdaac78fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:32.153020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de75cd-ed30-4b07-a959-d4bdaac78fa9 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:32.154369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 649/1293] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:12:32.159823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db059ca0-6325-49b2-8a93-b31e3a5e6e06 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:32.160267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db059ca0-6325-49b2-8a93-b31e3a5e6e06 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:32.160377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db059ca0-6325-49b2-8a93-b31e3a5e6e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:32.178625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-db059ca0-6325-49b2-8a93-b31e3a5e6e06 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:32.179823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-db059ca0-6325-49b2-8a93-b31e3a5e6e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:32.209637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:32.246818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 645/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:12:32.520347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de75cd-ed30-4b07-a959-d4bdaac78fa9 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:32.552619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:32.628128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de75cd-ed30-4b07-a959-d4bdaac78fa9 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:32.662917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818486f-e10e-4175-b84e-604e29475efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:32.663522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818486f-e10e-4175-b84e-604e29475efb None admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:32.663798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818486f-e10e-4175-b84e-604e29475efb None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:32.664072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818486f-e10e-4175-b84e-604e29475efb None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:32.664737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818486f-e10e-4175-b84e-604e29475efb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:32.666134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818486f-e10e-4175-b84e-604e29475efb None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:32.682916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 650/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Oct 6 12:12:32 2022] POST /identity/v3/services => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:12:34.836724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c17d-dd6f-4329-b026-aec7bbdc78c6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:34.837300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c17d-dd6f-4329-b026-aec7bbdc78c6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:34.837300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c17d-dd6f-4329-b026-aec7bbdc78c6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:34.838646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 646/1296] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:12:34.844427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2139d7-5c90-41d6-acec-87938d9372c6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:34.844865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2139d7-5c90-41d6-acec-87938d9372c6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:34.845126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2139d7-5c90-41d6-acec-87938d9372c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:34.863676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4d2139d7-5c90-41d6-acec-87938d9372c6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:34.864857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4d2139d7-5c90-41d6-acec-87938d9372c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:34.938357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 651/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:12:35.206472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270c17d-dd6f-4329-b026-aec7bbdc78c6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:35.306687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270c17d-dd6f-4329-b026-aec7bbdc78c6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:35.339343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:35.339965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:35.340246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:35.340518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:35.341105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:35.342484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:35.351605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:35.352763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:35.354057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 647/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:12:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:35.358660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2139d7-5c90-41d6-acec-87938d9372c6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:35.376251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:35.461824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2139d7-5c90-41d6-acec-87938d9372c6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:35.501259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:35.501866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:35.502164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:35.502437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:35.503041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] RBAC: Adding query filter params (name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:35.503347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:35.504708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:35.509889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 652/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Oct 6 12:12:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:35.516880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:35.551083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:35.627976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbf3fa-4a90-475c-927b-6ece96443706 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:35.666065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa73c31-26ed-45d4-8c23-4b865850e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:35.666676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73c31-26ed-45d4-8c23-4b865850e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:35.666959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73c31-26ed-45d4-8c23-4b865850e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:35.667231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73c31-26ed-45d4-8c23-4b865850e9d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:35.667940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa73c31-26ed-45d4-8c23-4b865850e9d3 None admin] RBAC: Adding query filter params (interface=public, service_id=7c6d08f92472403981d001b353bd6b03, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:35.668253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa73c31-26ed-45d4-8c23-4b865850e9d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:35.669682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa73c31-26ed-45d4-8c23-4b865850e9d3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:35.675080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 648/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Oct 6 12:12:35 2022] GET /identity/v3/endpoints?service_id=7c6d08f92472403981d001b353bd6b03&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:35.681821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:35.768898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:35.788270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bd1df-337c-44dd-8c87-a2ac071187ea None admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:35.823421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fcb3c-446f-47fe-a40d-e9f6839eae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:35.824023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcb3c-446f-47fe-a40d-e9f6839eae47 None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:35.824300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcb3c-446f-47fe-a40d-e9f6839eae47 None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:35.824569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcb3c-446f-47fe-a40d-e9f6839eae47 None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:35.825170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fcb3c-446f-47fe-a40d-e9f6839eae47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:35.826560 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fcb3c-446f-47fe-a40d-e9f6839eae47 None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:35.834166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 653/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Oct 6 12:12:35 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:12:38.026607 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eba94-4fa4-40e8-b37c-8294d9b9d9e1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:38.027147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eba94-4fa4-40e8-b37c-8294d9b9d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:38.027147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eba94-4fa4-40e8-b37c-8294d9b9d9e1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:38.028487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 649/1302] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:12:38.033753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff7b94-7007-4d18-a80e-90bc021ca856 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:38.034224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff7b94-7007-4d18-a80e-90bc021ca856 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:38.034316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff7b94-7007-4d18-a80e-90bc021ca856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:38.052401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-76ff7b94-7007-4d18-a80e-90bc021ca856 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:12:38.053638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-76ff7b94-7007-4d18-a80e-90bc021ca856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:12:38.121866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 654/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:12:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 06 12:12:38.395874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eba94-4fa4-40e8-b37c-8294d9b9d9e1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:38.491015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:38.497851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eba94-4fa4-40e8-b37c-8294d9b9d9e1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:38.532097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:38.532721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:38.533005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:38.533279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:38.533888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:38.535245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 06 12:12:38.543802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 06 12:12:38.545110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 06 12:12:38.546010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 650/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Oct 6 12:12:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 06 12:12:38.551604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff7b94-7007-4d18-a80e-90bc021ca856 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:38.625573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:38.649417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff7b94-7007-4d18-a80e-90bc021ca856 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:38.682828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301c4c5-3826-41bc-8932-fc0e3b357f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:38.683452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301c4c5-3826-41bc-8932-fc0e3b357f7e None admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:38.683731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301c4c5-3826-41bc-8932-fc0e3b357f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:38.684001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301c4c5-3826-41bc-8932-fc0e3b357f7e None admin] PATH_INFO: `/v3/services` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:38.684621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301c4c5-3826-41bc-8932-fc0e3b357f7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:12:38.684920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301c4c5-3826-41bc-8932-fc0e3b357f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:38.686313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301c4c5-3826-41bc-8932-fc0e3b357f7e None admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:38.691450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 655/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Oct 6 12:12:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:12:38.697237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:12:38.793865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528efd-ab3b-4bdf-95c8-2c46e92db816 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:12:38.827004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145ef34-398b-40e7-890a-53bb004207b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:12:38.827622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145ef34-398b-40e7-890a-53bb004207b5 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:12:38.827999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145ef34-398b-40e7-890a-53bb004207b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:12:38.828282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145ef34-398b-40e7-890a-53bb004207b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:12:38.828949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145ef34-398b-40e7-890a-53bb004207b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:12:38.830339 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145ef34-398b-40e7-890a-53bb004207b5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:12:38.849845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 651/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:12:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:12:48.688476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=30 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:12:48.845725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:13:45.779733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8ce7-6ae6-4aa8-b1e5-71fe3657a808 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:45.780816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8ce7-6ae6-4aa8-b1e5-71fe3657a808 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:45.781339 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8ce7-6ae6-4aa8-b1e5-71fe3657a808 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:45.787228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 656/1307] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:13:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:13:45.789110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036fdd2-f783-4def-89b7-da891be593a1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:45.790739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036fdd2-f783-4def-89b7-da891be593a1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:45.791217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036fdd2-f783-4def-89b7-da891be593a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:45.952367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6036fdd2-f783-4def-89b7-da891be593a1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:13:45.953781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6036fdd2-f783-4def-89b7-da891be593a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:46.153587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 652/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:13:46.436551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df1e4-235a-43f3-b322-9c112dfe6e35 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:46.436897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df1e4-235a-43f3-b322-9c112dfe6e35 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:46.437100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df1e4-235a-43f3-b322-9c112dfe6e35 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:46.438856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 657/1309] 10.222.0.15 () {54 vars in 964 bytes} [Thu Oct 6 12:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:13:46.450823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a4805-5ca1-4b79-8831-e7926dbb05cc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:46.451080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a4805-5ca1-4b79-8831-e7926dbb05cc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:46.451294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a4805-5ca1-4b79-8831-e7926dbb05cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:46.595148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c49a4805-5ca1-4b79-8831-e7926dbb05cc None None] MFA Rules not processed for user `c8bc6ac1df7f4bd383fded2b9a22ecf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:13:46.597028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c49a4805-5ca1-4b79-8831-e7926dbb05cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:46.665405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:13:46.823534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 653/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Oct 6 12:13:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:13:46.832528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361df1e4-235a-43f3-b322-9c112dfe6e35 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:13:46.835115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-361df1e4-235a-43f3-b322-9c112dfe6e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:46.983482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361df1e4-235a-43f3-b322-9c112dfe6e35 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:13:47.072419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad08e4-acfe-4689-8f57-3abdb27e22e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:13:47.073177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad08e4-acfe-4689-8f57-3abdb27e22e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:47.073463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad08e4-acfe-4689-8f57-3abdb27e22e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:47.073784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad08e4-acfe-4689-8f57-3abdb27e22e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:47.075544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6fad08e4-acfe-4689-8f57-3abdb27e22e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:47.145253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:13:47.217786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad08e4-acfe-4689-8f57-3abdb27e22e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:13:47.219140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad08e4-acfe-4689-8f57-3abdb27e22e0 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:13:47.240673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 658/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:13:50.212583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174c605-0783-4c00-8a31-8484d0a6bbe0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:50.214651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174c605-0783-4c00-8a31-8484d0a6bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:50.214651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174c605-0783-4c00-8a31-8484d0a6bbe0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:50.214651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 654/1312] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:13:50.220172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851230c-e881-42f1-b0ed-5e21b572ff45 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:50.220572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851230c-e881-42f1-b0ed-5e21b572ff45 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:50.220726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851230c-e881-42f1-b0ed-5e21b572ff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:50.302741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a851230c-e881-42f1-b0ed-5e21b572ff45 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:13:50.303965 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a851230c-e881-42f1-b0ed-5e21b572ff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:50.410127 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 659/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:13:50.744088 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174c605-0783-4c00-8a31-8484d0a6bbe0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:13:50.745682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d174c605-0783-4c00-8a31-8484d0a6bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:50.851313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174c605-0783-4c00-8a31-8484d0a6bbe0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:13:50.937349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:13:50.940279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146c691-1d3f-48b4-b84f-9ea48552a7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:13:50.941174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c691-1d3f-48b4-b84f-9ea48552a7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:50.941515 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c691-1d3f-48b4-b84f-9ea48552a7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:50.943341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c691-1d3f-48b4-b84f-9ea48552a7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:50.945307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c146c691-1d3f-48b4-b84f-9ea48552a7d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:51.083635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146c691-1d3f-48b4-b84f-9ea48552a7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:13:51.084991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146c691-1d3f-48b4-b84f-9ea48552a7d9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:13:51.105937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 655/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:13:53.725002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6da30-a7a1-4f96-b510-acf53f4ec2ee None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:53.725612 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6da30-a7a1-4f96-b510-acf53f4ec2ee None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:53.725612 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6da30-a7a1-4f96-b510-acf53f4ec2ee None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:53.727793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 660/1315] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:13:53.733267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3081c28-ae09-4d67-a3b1-240528e510e4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:53.733824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3081c28-ae09-4d67-a3b1-240528e510e4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:53.733824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3081c28-ae09-4d67-a3b1-240528e510e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:53.811153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a3081c28-ae09-4d67-a3b1-240528e510e4 None None] MFA Rules not processed for user `4566f2276f01462e910e3412f7107cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:13:53.812443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a3081c28-ae09-4d67-a3b1-240528e510e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:53.876594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:13:53.923426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 656/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:13:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:13:54.211645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6da30-a7a1-4f96-b510-acf53f4ec2ee None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:13:54.213195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d9e6da30-a7a1-4f96-b510-acf53f4ec2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:54.223273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:13:54.321755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6da30-a7a1-4f96-b510-acf53f4ec2ee None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:13:54.395717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072714-15ea-49ed-9d25-c00b41e6c58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:13:54.396374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072714-15ea-49ed-9d25-c00b41e6c58b service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:54.396653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072714-15ea-49ed-9d25-c00b41e6c58b service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:54.396925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072714-15ea-49ed-9d25-c00b41e6c58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:54.398711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ac072714-15ea-49ed-9d25-c00b41e6c58b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:54.466991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:13:54.514796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac072714-15ea-49ed-9d25-c00b41e6c58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:13:54.516236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac072714-15ea-49ed-9d25-c00b41e6c58b service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:13:54.534751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 661/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:13:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:13:57.291832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751db41-235c-4989-9d81-24029b690feb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:57.292399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751db41-235c-4989-9d81-24029b690feb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:57.292399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751db41-235c-4989-9d81-24029b690feb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:57.293837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 657/1318] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:13:57.299464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050333e-1504-47da-a6d6-6a435de15590 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:57.299887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050333e-1504-47da-a6d6-6a435de15590 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:57.300019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050333e-1504-47da-a6d6-6a435de15590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:57.372660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7050333e-1504-47da-a6d6-6a435de15590 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:13:57.373973 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7050333e-1504-47da-a6d6-6a435de15590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:57.477799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 662/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:13:57.762742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751db41-235c-4989-9d81-24029b690feb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:13:57.764688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3751db41-235c-4989-9d81-24029b690feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:57.880001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751db41-235c-4989-9d81-24029b690feb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:13:57.957636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abda77-88f5-48a1-b0c8-71cd770ff36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:13:57.958245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abda77-88f5-48a1-b0c8-71cd770ff36d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:13:57.958528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abda77-88f5-48a1-b0c8-71cd770ff36d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:13:57.958804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abda77-88f5-48a1-b0c8-71cd770ff36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:13:57.961073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-40abda77-88f5-48a1-b0c8-71cd770ff36d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:13:57.968336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:13:58.072347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abda77-88f5-48a1-b0c8-71cd770ff36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:13:58.073740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abda77-88f5-48a1-b0c8-71cd770ff36d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:13:58.092333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 658/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:13:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:01.003759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89450e-cc2f-43bb-8160-5807ac13a234 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:01.004309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89450e-cc2f-43bb-8160-5807ac13a234 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:01.004309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89450e-cc2f-43bb-8160-5807ac13a234 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:01.006863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 663/1321] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:14:01.013011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d44c-31fd-4718-a9aa-13496e09ce65 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:01.013496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d44c-31fd-4718-a9aa-13496e09ce65 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:01.013616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d44c-31fd-4718-a9aa-13496e09ce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:01.087303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-21f7d44c-31fd-4718-a9aa-13496e09ce65 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:01.088772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-21f7d44c-31fd-4718-a9aa-13496e09ce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:01.162259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:01.208116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 659/1322] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:01.495395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89450e-cc2f-43bb-8160-5807ac13a234 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:01.497017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8b89450e-cc2f-43bb-8160-5807ac13a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:01.518704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:01.625974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89450e-cc2f-43bb-8160-5807ac13a234 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:01.705167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801621a-1442-49bb-b19d-b98b871e4db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:01.705804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801621a-1442-49bb-b19d-b98b871e4db8 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:01.706077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801621a-1442-49bb-b19d-b98b871e4db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:01.706345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801621a-1442-49bb-b19d-b98b871e4db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:01.708083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b801621a-1442-49bb-b19d-b98b871e4db8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:01.791260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:01.837638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801621a-1442-49bb-b19d-b98b871e4db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:01.839201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801621a-1442-49bb-b19d-b98b871e4db8 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:01.859782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 664/1323] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:04.171476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa851f1-77b6-4036-ac1d-fba0f0ed8402 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:04.172042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa851f1-77b6-4036-ac1d-fba0f0ed8402 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:04.172137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa851f1-77b6-4036-ac1d-fba0f0ed8402 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:04.173447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 660/1324] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:04.179445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7433a-a7ff-4331-9668-b7405b48fc4c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:04.180712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7433a-a7ff-4331-9668-b7405b48fc4c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:04.180712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7433a-a7ff-4331-9668-b7405b48fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:04.251427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e1d7433a-a7ff-4331-9668-b7405b48fc4c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:04.252652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e1d7433a-a7ff-4331-9668-b7405b48fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:04.371997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 665/1325] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:04.655876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa851f1-77b6-4036-ac1d-fba0f0ed8402 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:04.657453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0aa851f1-77b6-4036-ac1d-fba0f0ed8402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:04.767614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa851f1-77b6-4036-ac1d-fba0f0ed8402 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:04.852251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4600e-f43e-421c-970b-bc0c1ce243c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:04.852870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4600e-f43e-421c-970b-bc0c1ce243c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:04.853154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4600e-f43e-421c-970b-bc0c1ce243c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:04.853449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4600e-f43e-421c-970b-bc0c1ce243c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:04.855101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-53e4600e-f43e-421c-970b-bc0c1ce243c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:04.872972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:04.973031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4600e-f43e-421c-970b-bc0c1ce243c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:04.974405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4600e-f43e-421c-970b-bc0c1ce243c8 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:04.996307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 661/1326] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:07.292480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abecda-252e-48a6-8801-61ae430192fc None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:07.292989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abecda-252e-48a6-8801-61ae430192fc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:07.292989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abecda-252e-48a6-8801-61ae430192fc None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:07.294373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 666/1327] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:07.299740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79377-1d4c-4cd4-ba91-e4415ead52bf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:07.300208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79377-1d4c-4cd4-ba91-e4415ead52bf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:07.300304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79377-1d4c-4cd4-ba91-e4415ead52bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:07.372790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-10b79377-1d4c-4cd4-ba91-e4415ead52bf None None] MFA Rules not processed for user `4566f2276f01462e910e3412f7107cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:07.373980 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10b79377-1d4c-4cd4-ba91-e4415ead52bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:07.453821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:07.487197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 662/1328] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:07.787768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913376a2-755f-4e40-bc5d-42a135282f6c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:07.788096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913376a2-755f-4e40-bc5d-42a135282f6c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:07.788462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913376a2-755f-4e40-bc5d-42a135282f6c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:07.790235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 667/1329] 10.222.0.15 () {54 vars in 964 bytes} [Thu Oct 6 12:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:07.796630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33d86-486f-4a71-aa70-3cfca0eb4aae None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:07.797291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33d86-486f-4a71-aa70-3cfca0eb4aae None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:07.797291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33d86-486f-4a71-aa70-3cfca0eb4aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:07.900800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c5a33d86-486f-4a71-aa70-3cfca0eb4aae None None] MFA Rules not processed for user `c8bc6ac1df7f4bd383fded2b9a22ecf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:07.902075 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c5a33d86-486f-4a71-aa70-3cfca0eb4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:07.999053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 663/1330] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Oct 6 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:08.009361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913376a2-755f-4e40-bc5d-42a135282f6c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:08.010937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-913376a2-755f-4e40-bc5d-42a135282f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:08.056418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:08.149200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913376a2-755f-4e40-bc5d-42a135282f6c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:08.233256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40116ed4-98f5-40c8-ba42-8ee20abe5748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:08.233813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116ed4-98f5-40c8-ba42-8ee20abe5748 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:08.234092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116ed4-98f5-40c8-ba42-8ee20abe5748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:08.234361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116ed4-98f5-40c8-ba42-8ee20abe5748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:08.235987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-40116ed4-98f5-40c8-ba42-8ee20abe5748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:08.319272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:08.353175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40116ed4-98f5-40c8-ba42-8ee20abe5748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:08.354828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40116ed4-98f5-40c8-ba42-8ee20abe5748 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:08.373621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 668/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:11.253316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b196a-8bb9-4267-9e9a-5b70b082dc37 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:11.253930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b196a-8bb9-4267-9e9a-5b70b082dc37 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:11.253930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b196a-8bb9-4267-9e9a-5b70b082dc37 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:11.255266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 664/1332] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:11.261874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebf79-3576-4485-a9d0-19eebf5cb7c6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:11.262389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebf79-3576-4485-a9d0-19eebf5cb7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:11.262389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebf79-3576-4485-a9d0-19eebf5cb7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:11.339962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-764ebf79-3576-4485-a9d0-19eebf5cb7c6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:11.341185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-764ebf79-3576-4485-a9d0-19eebf5cb7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:11.449384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 669/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:11.734382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b196a-8bb9-4267-9e9a-5b70b082dc37 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:11.735936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f37b196a-8bb9-4267-9e9a-5b70b082dc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:11.808903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:11.845738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b196a-8bb9-4267-9e9a-5b70b082dc37 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:11.928285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cc70a-eee4-4b22-9749-fecc28d36eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:11.928902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cc70a-eee4-4b22-9749-fecc28d36eba service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:11.929213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cc70a-eee4-4b22-9749-fecc28d36eba service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:11.929489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cc70a-eee4-4b22-9749-fecc28d36eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:11.931172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-807cc70a-eee4-4b22-9749-fecc28d36eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:12.051339 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cc70a-eee4-4b22-9749-fecc28d36eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:12.052745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cc70a-eee4-4b22-9749-fecc28d36eba service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:12.063649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:12.074833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 665/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:14.345495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ad0d2-3e0d-4619-8f7b-f724740bfa39 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:14.346087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ad0d2-3e0d-4619-8f7b-f724740bfa39 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:14.346087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ad0d2-3e0d-4619-8f7b-f724740bfa39 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:14.347440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 670/1335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:14.353574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7203b-b2cb-45d2-b25e-954b58a5b057 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:14.354054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7203b-b2cb-45d2-b25e-954b58a5b057 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:14.354141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7203b-b2cb-45d2-b25e-954b58a5b057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:14.424218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-51f7203b-b2cb-45d2-b25e-954b58a5b057 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:14.425379 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-51f7203b-b2cb-45d2-b25e-954b58a5b057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:14.525567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 666/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:14.814181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ad0d2-3e0d-4619-8f7b-f724740bfa39 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:14.815696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9a0ad0d2-3e0d-4619-8f7b-f724740bfa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:14.859821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:14.926725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ad0d2-3e0d-4619-8f7b-f724740bfa39 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:15.006779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c8b64-dd4d-4d09-ac1a-1711ec0e11c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:15.007390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c8b64-dd4d-4d09-ac1a-1711ec0e11c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:15.007670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c8b64-dd4d-4d09-ac1a-1711ec0e11c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:15.007938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c8b64-dd4d-4d09-ac1a-1711ec0e11c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:15.009833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-320c8b64-dd4d-4d09-ac1a-1711ec0e11c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:15.095122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:15.125028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c8b64-dd4d-4d09-ac1a-1711ec0e11c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:15.126550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c8b64-dd4d-4d09-ac1a-1711ec0e11c3 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:15.146007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 671/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:14:17.985693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070cc5f-a62d-4cb0-9e87-2672a15f229a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:17.986306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070cc5f-a62d-4cb0-9e87-2672a15f229a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:17.986306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070cc5f-a62d-4cb0-9e87-2672a15f229a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:17.987593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 667/1338] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:17.993439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a61af-c732-4e4b-99d9-93781faf565a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:17.994329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a61af-c732-4e4b-99d9-93781faf565a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:17.994329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a61af-c732-4e4b-99d9-93781faf565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:18.064629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a27a61af-c732-4e4b-99d9-93781faf565a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:18.065821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a27a61af-c732-4e4b-99d9-93781faf565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:18.171401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 672/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:14:18.456413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070cc5f-a62d-4cb0-9e87-2672a15f229a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:18.458876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e070cc5f-a62d-4cb0-9e87-2672a15f229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:18.549709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:18.591430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070cc5f-a62d-4cb0-9e87-2672a15f229a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:18.668446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35072a-fb1f-4b1f-a209-5c4ceb1fe7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:18.669058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35072a-fb1f-4b1f-a209-5c4ceb1fe7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:18.669338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35072a-fb1f-4b1f-a209-5c4ceb1fe7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:18.669706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35072a-fb1f-4b1f-a209-5c4ceb1fe7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:18.671441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a35072a-fb1f-4b1f-a209-5c4ceb1fe7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:18.792420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35072a-fb1f-4b1f-a209-5c4ceb1fe7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:18.793886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35072a-fb1f-4b1f-a209-5c4ceb1fe7a5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:18.812211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 668/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:23.157126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c053eb-7b11-4cc6-93b8-44b13117f003 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:23.157681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c053eb-7b11-4cc6-93b8-44b13117f003 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:23.157681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c053eb-7b11-4cc6-93b8-44b13117f003 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:23.159039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 673/1341] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:23.164656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a52b8-df44-46f1-b582-75c9349f85e1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:23.165176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a52b8-df44-46f1-b582-75c9349f85e1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:23.165278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a52b8-df44-46f1-b582-75c9349f85e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:23.170886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:23.240408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f68a52b8-df44-46f1-b582-75c9349f85e1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:23.241694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f68a52b8-df44-46f1-b582-75c9349f85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:23.348279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 669/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:23.636545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c053eb-7b11-4cc6-93b8-44b13117f003 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:23.638118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b9c053eb-7b11-4cc6-93b8-44b13117f003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:23.698017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:23.757891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c053eb-7b11-4cc6-93b8-44b13117f003 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:23.841420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf565d1-2798-4175-9f87-a3de35c26ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:23.842049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf565d1-2798-4175-9f87-a3de35c26ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:23.842329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf565d1-2798-4175-9f87-a3de35c26ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:23.842603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf565d1-2798-4175-9f87-a3de35c26ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:23.844231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-faf565d1-2798-4175-9f87-a3de35c26ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:23.940846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:23.961309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf565d1-2798-4175-9f87-a3de35c26ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:23.962787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf565d1-2798-4175-9f87-a3de35c26ba2 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:23.983994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 674/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:26.889175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5466-2564-426f-aa5f-dcf054935eef None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:26.889793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5466-2564-426f-aa5f-dcf054935eef None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:26.889891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5466-2564-426f-aa5f-dcf054935eef None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:26.891182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 670/1344] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:26.896699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e381dff-72f0-4d82-8154-36f6499367db None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:26.897222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e381dff-72f0-4d82-8154-36f6499367db None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:26.897222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e381dff-72f0-4d82-8154-36f6499367db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:26.969165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1e381dff-72f0-4d82-8154-36f6499367db None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:26.970417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1e381dff-72f0-4d82-8154-36f6499367db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:27.074814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 675/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:27.356921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d5466-2564-426f-aa5f-dcf054935eef None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:27.358628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a62d5466-2564-426f-aa5f-dcf054935eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:27.456052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:27.487924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d5466-2564-426f-aa5f-dcf054935eef None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:27.568639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03d9b9-1373-4a76-a41b-a47d615d9041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:27.569188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d9b9-1373-4a76-a41b-a47d615d9041 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:27.569468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d9b9-1373-4a76-a41b-a47d615d9041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:27.569774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d9b9-1373-4a76-a41b-a47d615d9041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:27.571427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc03d9b9-1373-4a76-a41b-a47d615d9041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:27.698589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03d9b9-1373-4a76-a41b-a47d615d9041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:27.700030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03d9b9-1373-4a76-a41b-a47d615d9041 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:27.719418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 671/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:32.367552 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658c0c0-314b-4cb2-84bb-9cd6e3965c4d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:32.368095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658c0c0-314b-4cb2-84bb-9cd6e3965c4d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:32.368095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658c0c0-314b-4cb2-84bb-9cd6e3965c4d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:32.369438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 676/1347] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:32.375136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcc586-4351-4f72-b4f0-69a558f1a3e9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:32.375595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcc586-4351-4f72-b4f0-69a558f1a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:32.375696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcc586-4351-4f72-b4f0-69a558f1a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:32.392687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:32.454579 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-19dcc586-4351-4f72-b4f0-69a558f1a3e9 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:32.455829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19dcc586-4351-4f72-b4f0-69a558f1a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:32.561722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 672/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:32.852462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658c0c0-314b-4cb2-84bb-9cd6e3965c4d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:32.854080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d658c0c0-314b-4cb2-84bb-9cd6e3965c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:32.916531 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:32.968735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658c0c0-314b-4cb2-84bb-9cd6e3965c4d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:33.053450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cb93c-9121-48ab-973b-d842027035e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:33.054117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cb93c-9121-48ab-973b-d842027035e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:33.054401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cb93c-9121-48ab-973b-d842027035e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:33.054674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cb93c-9121-48ab-973b-d842027035e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:33.056316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d83cb93c-9121-48ab-973b-d842027035e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:33.174845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:33.179951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cb93c-9121-48ab-973b-d842027035e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:33.181427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cb93c-9121-48ab-973b-d842027035e5 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:33.201441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 677/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:38.453178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2c966-eb29-4f68-b7a4-b408e3d2ee61 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:38.454205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2c966-eb29-4f68-b7a4-b408e3d2ee61 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:38.454723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2c966-eb29-4f68-b7a4-b408e3d2ee61 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:38.456625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 673/1350] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:38.464821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d255-c021-42fd-81a0-7c62e5c3be07 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:38.465363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d255-c021-42fd-81a0-7c62e5c3be07 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:38.465363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d255-c021-42fd-81a0-7c62e5c3be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:38.593463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-78e6d255-c021-42fd-81a0-7c62e5c3be07 None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:38.594864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-78e6d255-c021-42fd-81a0-7c62e5c3be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:38.764085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 678/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:14:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:42.560179 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=59 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:43.480153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22acc-6c0f-4d08-879c-54332edb9b0e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:43.480801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22acc-6c0f-4d08-879c-54332edb9b0e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:43.481335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22acc-6c0f-4d08-879c-54332edb9b0e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:43.484158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 674/1352] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:14:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:43.494561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a2b9-5bcc-4811-8b3a-e47a9d7a5669 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:43.495760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a2b9-5bcc-4811-8b3a-e47a9d7a5669 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:43.496154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a2b9-5bcc-4811-8b3a-e47a9d7a5669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:43.568564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:43.594797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6d78a2b9-5bcc-4811-8b3a-e47a9d7a5669 None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:43.596238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6d78a2b9-5bcc-4811-8b3a-e47a9d7a5669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:43.720112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 679/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:44.902134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f924b7-affc-48c2-b457-58d59267c9fc None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:44.902689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f924b7-affc-48c2-b457-58d59267c9fc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:44.902689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f924b7-affc-48c2-b457-58d59267c9fc None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:44.904014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 675/1354] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:44.909253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82ba9-d004-4f29-b9c1-e742b329171e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:44.909773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82ba9-d004-4f29-b9c1-e742b329171e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:44.909912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82ba9-d004-4f29-b9c1-e742b329171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:44.994764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-20a82ba9-d004-4f29-b9c1-e742b329171e None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:44.995995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-20a82ba9-d004-4f29-b9c1-e742b329171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:45.045785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:45.134134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 680/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:14:48.699653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8547-d681-438d-adc4-da44e37ed146 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:48.700247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8547-d681-438d-adc4-da44e37ed146 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:48.700549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8547-d681-438d-adc4-da44e37ed146 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:48.708802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 676/1356] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:48.715897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5d80a-d165-4ca1-aa60-d007b7e7363d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:48.717831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5d80a-d165-4ca1-aa60-d007b7e7363d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:48.718289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5d80a-d165-4ca1-aa60-d007b7e7363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:48.810158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2cb5d80a-d165-4ca1-aa60-d007b7e7363d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:48.811702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2cb5d80a-d165-4ca1-aa60-d007b7e7363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:48.934316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 681/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:49.253687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e382-7cf7-4642-a4e0-f52399c63a90 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:49.254171 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e382-7cf7-4642-a4e0-f52399c63a90 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:49.254625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e382-7cf7-4642-a4e0-f52399c63a90 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:49.256365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 677/1358] 10.222.0.15 () {54 vars in 961 bytes} [Thu Oct 6 12:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:49.274401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38d948-230f-44ce-9903-3cacf3a2372f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:49.275589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38d948-230f-44ce-9903-3cacf3a2372f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:49.277823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38d948-230f-44ce-9903-3cacf3a2372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:49.332496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:49.408753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ab38d948-230f-44ce-9903-3cacf3a2372f None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:49.410102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ab38d948-230f-44ce-9903-3cacf3a2372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:49.557960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 682/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Oct 6 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:49.562530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357e382-7cf7-4642-a4e0-f52399c63a90 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:49.564267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2357e382-7cf7-4642-a4e0-f52399c63a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:49.772838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357e382-7cf7-4642-a4e0-f52399c63a90 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:49.859234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:49.910235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04701087-86cd-43c5-b47c-bee5ee402bac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:49.911202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701087-86cd-43c5-b47c-bee5ee402bac service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:49.911473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701087-86cd-43c5-b47c-bee5ee402bac service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:49.911747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701087-86cd-43c5-b47c-bee5ee402bac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:49.914304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-04701087-86cd-43c5-b47c-bee5ee402bac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:50.029099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04701087-86cd-43c5-b47c-bee5ee402bac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:50.030726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04701087-86cd-43c5-b47c-bee5ee402bac service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:50.053045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 678/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:52.512165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02608d-d335-4c81-bfab-ca6321c773af None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:52.512821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02608d-d335-4c81-bfab-ca6321c773af None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:52.512821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02608d-d335-4c81-bfab-ca6321c773af None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:52.514245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 683/1361] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:52.519931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a85ba-88d5-4273-b427-d4bda225eab2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:52.520464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a85ba-88d5-4273-b427-d4bda225eab2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:52.520558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a85ba-88d5-4273-b427-d4bda225eab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:52.610720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e32a85ba-88d5-4273-b427-d4bda225eab2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:52.612052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e32a85ba-88d5-4273-b427-d4bda225eab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:52.662167 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:52.749606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 679/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:53.065712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02608d-d335-4c81-bfab-ca6321c773af None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:53.067332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9e02608d-d335-4c81-bfab-ca6321c773af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:53.159582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:53.276242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02608d-d335-4c81-bfab-ca6321c773af None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:53.409288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd1a20-b872-41b1-831f-d7462aff42bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:53.409950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1a20-b872-41b1-831f-d7462aff42bb service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:53.410233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1a20-b872-41b1-831f-d7462aff42bb service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:53.410507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1a20-b872-41b1-831f-d7462aff42bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:53.412235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-42fd1a20-b872-41b1-831f-d7462aff42bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:53.441185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:53.522197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd1a20-b872-41b1-831f-d7462aff42bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:53.524476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd1a20-b872-41b1-831f-d7462aff42bb service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:53.551437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 684/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:56.150841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1502c-ad94-4b56-919b-f0c9073d6ed7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:56.151430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1502c-ad94-4b56-919b-f0c9073d6ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:56.151430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1502c-ad94-4b56-919b-f0c9073d6ed7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:56.152958 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 680/1364] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:56.158266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e3e6-5e50-4b98-8916-195025d0faf0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:56.158793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e3e6-5e50-4b98-8916-195025d0faf0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:56.158877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e3e6-5e50-4b98-8916-195025d0faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:56.237428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6528e3e6-5e50-4b98-8916-195025d0faf0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:56.239101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6528e3e6-5e50-4b98-8916-195025d0faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:56.347043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:56.362710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 685/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:56.668181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e079a2-4f67-4cb6-87f1-0461fe6ef892 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:56.668530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e079a2-4f67-4cb6-87f1-0461fe6ef892 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:56.668743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e079a2-4f67-4cb6-87f1-0461fe6ef892 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:56.670374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 681/1366] 10.222.0.15 () {54 vars in 961 bytes} [Thu Oct 6 12:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:56.676228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136dbc0-e728-4cc2-b126-2e6f6fcc464e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:56.676513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136dbc0-e728-4cc2-b126-2e6f6fcc464e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:56.676786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136dbc0-e728-4cc2-b126-2e6f6fcc464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:56.763679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b136dbc0-e728-4cc2-b126-2e6f6fcc464e None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:56.764892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b136dbc0-e728-4cc2-b126-2e6f6fcc464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:56.903312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 686/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Oct 6 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:56.912027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e079a2-4f67-4cb6-87f1-0461fe6ef892 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:56.914534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-89e079a2-4f67-4cb6-87f1-0461fe6ef892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:57.091258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e079a2-4f67-4cb6-87f1-0461fe6ef892 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:57.119721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:57.234063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf0f6-849e-48b9-ad29-de5ac81649a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:57.234707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf0f6-849e-48b9-ad29-de5ac81649a9 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:57.234835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf0f6-849e-48b9-ad29-de5ac81649a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:57.235086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf0f6-849e-48b9-ad29-de5ac81649a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:57.236692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b2fdf0f6-849e-48b9-ad29-de5ac81649a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:57.337857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdf0f6-849e-48b9-ad29-de5ac81649a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:57.339507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdf0f6-849e-48b9-ad29-de5ac81649a9 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:57.360548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 682/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:58.500945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f5c0-ad10-4397-b1eb-eaa13aef771f None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:58.501473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f5c0-ad10-4397-b1eb-eaa13aef771f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:58.501473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f5c0-ad10-4397-b1eb-eaa13aef771f None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:58.502943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 687/1369] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:58.516438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51cb0-4372-4413-948a-075369351961 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:58.517783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51cb0-4372-4413-948a-075369351961 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:58.518256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51cb0-4372-4413-948a-075369351961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:58.552998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:58.600053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-04f51cb0-4372-4413-948a-075369351961 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:58.603011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-04f51cb0-4372-4413-948a-075369351961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:58.737621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 683/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:59.121708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809e580-6b40-4813-bf5f-7bc55ec07705 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:59.122165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809e580-6b40-4813-bf5f-7bc55ec07705 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:59.122421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809e580-6b40-4813-bf5f-7bc55ec07705 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:59.128204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 688/1371] 10.222.0.15 () {54 vars in 963 bytes} [Thu Oct 6 12:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:59.131939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51164af6-df25-47d5-953d-741ed79aa8f2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:59.133122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51164af6-df25-47d5-953d-741ed79aa8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:59.133465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51164af6-df25-47d5-953d-741ed79aa8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:59.228051 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-51164af6-df25-47d5-953d-741ed79aa8f2 None None] MFA Rules not processed for user `f401923fe84446b9962e854f1fc2bed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:59.229397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-51164af6-df25-47d5-953d-741ed79aa8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:59.292122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:59.329034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 684/1372] 10.222.0.15 () {58 vars in 1060 bytes} [Thu Oct 6 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:14:59.345866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809e580-6b40-4813-bf5f-7bc55ec07705 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:14:59.347807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1809e580-6b40-4813-bf5f-7bc55ec07705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:59.420626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:59.494856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809e580-6b40-4813-bf5f-7bc55ec07705 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:14:59.595195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:14:59.595932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:59.596117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:59.596379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:59.598079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:59.674193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43587ab-4735-462d-8aae-bee2ccb052b2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:59.674678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43587ab-4735-462d-8aae-bee2ccb052b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:59.674678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43587ab-4735-462d-8aae-bee2ccb052b2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:59.676030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 685/1373] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:14:59.682325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3d8d-fc02-4449-ac66-9804c0d80e48 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:14:59.682940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3d8d-fc02-4449-ac66-9804c0d80e48 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:14:59.683328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3d8d-fc02-4449-ac66-9804c0d80e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:14:59.727977 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:14:59.747381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:14:59.749075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:14:59.768860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0bed3d8d-fc02-4449-ac66-9804c0d80e48 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:14:59.770215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0bed3d8d-fc02-4449-ac66-9804c0d80e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:14:59.781730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 689/1374] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:14:59.906355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 686/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:15:00.198122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:00.199349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:00.308724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0c9af-3822-4254-9c56-747ff00a0247 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:00.416882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:00.431394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf001a8-df79-47bb-8dfb-cf9f8d43e85b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:00.431765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf001a8-df79-47bb-8dfb-cf9f8d43e85b service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:00.432048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf001a8-df79-47bb-8dfb-cf9f8d43e85b service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:00.432314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf001a8-df79-47bb-8dfb-cf9f8d43e85b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:00.434000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2cf001a8-df79-47bb-8dfb-cf9f8d43e85b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:00.546634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf001a8-df79-47bb-8dfb-cf9f8d43e85b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:00.548549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf001a8-df79-47bb-8dfb-cf9f8d43e85b service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:00.570624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 690/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:02.907003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44956266-e861-4936-ac4d-1d079283b043 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:02.907521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44956266-e861-4936-ac4d-1d079283b043 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:02.907621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44956266-e861-4936-ac4d-1d079283b043 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:02.909036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 687/1377] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:02.918248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8a485-4ae0-47c3-89d8-7f3f109db8f0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:02.918248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8a485-4ae0-47c3-89d8-7f3f109db8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:02.918248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8a485-4ae0-47c3-89d8-7f3f109db8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:02.989578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-65d8a485-4ae0-47c3-89d8-7f3f109db8f0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:02.990935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-65d8a485-4ae0-47c3-89d8-7f3f109db8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:03.078196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:03.123857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 691/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:03.424561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44956266-e861-4936-ac4d-1d079283b043 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:03.426180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-44956266-e861-4936-ac4d-1d079283b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:03.515269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:03.644295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44956266-e861-4936-ac4d-1d079283b043 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:03.777045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616eb05-af9e-4b4c-850c-4e4d7a5c9928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:03.777744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eb05-af9e-4b4c-850c-4e4d7a5c9928 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:03.778036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eb05-af9e-4b4c-850c-4e4d7a5c9928 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:03.778316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eb05-af9e-4b4c-850c-4e4d7a5c9928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:03.779970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0616eb05-af9e-4b4c-850c-4e4d7a5c9928 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:03.794460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:03.884827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616eb05-af9e-4b4c-850c-4e4d7a5c9928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:03.886576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616eb05-af9e-4b4c-850c-4e4d7a5c9928 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:03.908351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 688/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:06.225579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e255-01d8-4930-8051-1c0a61e519d6 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:06.226174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e255-01d8-4930-8051-1c0a61e519d6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:06.226174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e255-01d8-4930-8051-1c0a61e519d6 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:06.228489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 692/1380] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:06.234194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766383a-5919-4822-b3eb-b9a4011b92be None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:06.235102 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766383a-5919-4822-b3eb-b9a4011b92be None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:06.235102 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766383a-5919-4822-b3eb-b9a4011b92be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:06.310707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2766383a-5919-4822-b3eb-b9a4011b92be None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:06.312145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2766383a-5919-4822-b3eb-b9a4011b92be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:06.433443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:06.458007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 689/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:06.776992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483e255-01d8-4930-8051-1c0a61e519d6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:06.778563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0483e255-01d8-4930-8051-1c0a61e519d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:06.969359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483e255-01d8-4930-8051-1c0a61e519d6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:07.032193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:07.116313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194dec2-abcf-432b-8f2f-542a6f580548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:07.116927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194dec2-abcf-432b-8f2f-542a6f580548 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:07.117288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194dec2-abcf-432b-8f2f-542a6f580548 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:07.118205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194dec2-abcf-432b-8f2f-542a6f580548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:07.119859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0194dec2-abcf-432b-8f2f-542a6f580548 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:07.239420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194dec2-abcf-432b-8f2f-542a6f580548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:07.241800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194dec2-abcf-432b-8f2f-542a6f580548 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:07.266549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 693/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:15:09.528590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5504-c980-48a1-8bc9-61bb723e2733 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:09.529202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5504-c980-48a1-8bc9-61bb723e2733 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:09.529202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5504-c980-48a1-8bc9-61bb723e2733 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:09.530412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 690/1383] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:09.536472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281574e-db48-44e2-a6fe-0fd762382b7e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:09.536960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281574e-db48-44e2-a6fe-0fd762382b7e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:09.537172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281574e-db48-44e2-a6fe-0fd762382b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:09.627754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5281574e-db48-44e2-a6fe-0fd762382b7e None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:09.629346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5281574e-db48-44e2-a6fe-0fd762382b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:09.632049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:09.764764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 694/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:10.061704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb5504-c980-48a1-8bc9-61bb723e2733 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:10.063764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0adb5504-c980-48a1-8bc9-61bb723e2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:10.237643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb5504-c980-48a1-8bc9-61bb723e2733 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:10.313560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:10.371374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052bbc-8269-4b77-9de7-bfd9d32f2e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:10.372176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052bbc-8269-4b77-9de7-bfd9d32f2e49 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:10.372533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052bbc-8269-4b77-9de7-bfd9d32f2e49 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:10.372890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052bbc-8269-4b77-9de7-bfd9d32f2e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:10.375196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a8052bbc-8269-4b77-9de7-bfd9d32f2e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:10.489585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052bbc-8269-4b77-9de7-bfd9d32f2e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:10.491841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052bbc-8269-4b77-9de7-bfd9d32f2e49 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:10.522237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 691/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:13.405581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b38a-6159-49ac-b7d4-215205a8a488 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:13.406126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b38a-6159-49ac-b7d4-215205a8a488 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:13.406229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b38a-6159-49ac-b7d4-215205a8a488 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:13.407509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 695/1386] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:13.415671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404154-d974-4551-b5c9-5d109a96c3a3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:13.415671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404154-d974-4551-b5c9-5d109a96c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:13.416308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404154-d974-4551-b5c9-5d109a96c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:13.494567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6a404154-d974-4551-b5c9-5d109a96c3a3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:13.495907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6a404154-d974-4551-b5c9-5d109a96c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:13.531423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:13.619735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 692/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:15:13.919781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8b38a-6159-49ac-b7d4-215205a8a488 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:13.921336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4aa8b38a-6159-49ac-b7d4-215205a8a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:14.065370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:14.091875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8b38a-6159-49ac-b7d4-215205a8a488 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:14.223553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e4a95-ae69-4a06-b04d-6524d10818f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:14.224166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e4a95-ae69-4a06-b04d-6524d10818f1 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:14.224441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e4a95-ae69-4a06-b04d-6524d10818f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:14.224704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e4a95-ae69-4a06-b04d-6524d10818f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:14.226342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-028e4a95-ae69-4a06-b04d-6524d10818f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:14.329837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e4a95-ae69-4a06-b04d-6524d10818f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:14.332215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e4a95-ae69-4a06-b04d-6524d10818f1 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:14.340984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:14.359383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 696/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:15.762503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94d3c3-79ee-4200-82f0-a05894bc0b69 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:15.763059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94d3c3-79ee-4200-82f0-a05894bc0b69 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:15.763059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94d3c3-79ee-4200-82f0-a05894bc0b69 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:15.764791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 693/1389] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:15.770406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e936a3-f477-4289-b118-b41500920815 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:15.770877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e936a3-f477-4289-b118-b41500920815 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:15.771089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e936a3-f477-4289-b118-b41500920815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:15.847309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-14e936a3-f477-4289-b118-b41500920815 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:15.848549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-14e936a3-f477-4289-b118-b41500920815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:15.952509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 697/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:16.267550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d33b4-b6ec-4cbc-8ef8-96e70320d5ad None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:16.267821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d33b4-b6ec-4cbc-8ef8-96e70320d5ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:16.268101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d33b4-b6ec-4cbc-8ef8-96e70320d5ad None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:16.269445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 694/1391] 10.222.0.15 () {54 vars in 962 bytes} [Thu Oct 6 12:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:16.276048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe3262-81eb-434d-b990-c0e64f10904c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:16.276487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe3262-81eb-434d-b990-c0e64f10904c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:16.276928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe3262-81eb-434d-b990-c0e64f10904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:16.371140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a8fe3262-81eb-434d-b990-c0e64f10904c None None] MFA Rules not processed for user `945f11bdc38e4728a78449d99a0fcbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:16.372356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a8fe3262-81eb-434d-b990-c0e64f10904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:16.389969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:16.460811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 698/1392] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Oct 6 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:16.468862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d33b4-b6ec-4cbc-8ef8-96e70320d5ad None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:16.470430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-377d33b4-b6ec-4cbc-8ef8-96e70320d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:16.601426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d33b4-b6ec-4cbc-8ef8-96e70320d5ad None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:16.643343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83621-db81-49be-856c-1bd4afa60378 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:16.643555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83621-db81-49be-856c-1bd4afa60378 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:16.643810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83621-db81-49be-856c-1bd4afa60378 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:16.645575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 699/1393] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:15:16.651458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3edc11-220c-447b-b9d0-ea6dfec166c2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:16.652011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3edc11-220c-447b-b9d0-ea6dfec166c2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:16.652529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3edc11-220c-447b-b9d0-ea6dfec166c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:16.666468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:16.691218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56d47f-d4dd-4670-8206-7213b99afc6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:16.691834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d47f-d4dd-4670-8206-7213b99afc6f service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:16.692119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d47f-d4dd-4670-8206-7213b99afc6f service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:16.692393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d47f-d4dd-4670-8206-7213b99afc6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:16.694046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ad56d47f-d4dd-4670-8206-7213b99afc6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:16.730081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2d3edc11-220c-447b-b9d0-ea6dfec166c2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:16.731312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d3edc11-220c-447b-b9d0-ea6dfec166c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:16.819259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56d47f-d4dd-4670-8206-7213b99afc6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:16.820708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56d47f-d4dd-4670-8206-7213b99afc6f service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:16.835107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 700/1394] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:16.842107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 695/1395] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:17.128636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3edc11-220c-447b-b9d0-ea6dfec166c2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:17.129889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2d3edc11-220c-447b-b9d0-ea6dfec166c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:17.150199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:17.271522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3edc11-220c-447b-b9d0-ea6dfec166c2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:17.402016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b588c93-9456-4dae-95f9-82413da841b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:17.402631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588c93-9456-4dae-95f9-82413da841b4 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:17.402905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588c93-9456-4dae-95f9-82413da841b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:17.403173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588c93-9456-4dae-95f9-82413da841b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:17.404787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3b588c93-9456-4dae-95f9-82413da841b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:17.421425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:17.516497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b588c93-9456-4dae-95f9-82413da841b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:17.518181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b588c93-9456-4dae-95f9-82413da841b4 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:17.547393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 701/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:17.630693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b8571-ed9b-4718-8463-a777b6dd21e2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:17.631132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b8571-ed9b-4718-8463-a777b6dd21e2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:17.631479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b8571-ed9b-4718-8463-a777b6dd21e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:17.711869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b61b8571-ed9b-4718-8463-a777b6dd21e2 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:17.713195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b61b8571-ed9b-4718-8463-a777b6dd21e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:17.754441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:17.821403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 696/1397] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:17.870854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6c3fb-2f59-4d19-885f-cf97adecdcc2 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:17.871403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6c3fb-2f59-4d19-885f-cf97adecdcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:17.871403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6c3fb-2f59-4d19-885f-cf97adecdcc2 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:17.872797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 702/1398] 10.222.0.15 () {54 vars in 943 bytes} [Thu Oct 6 12:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:17.879673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1025-29f1-4add-a39f-6a7f6f3a8aed None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:17.879964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1025-29f1-4add-a39f-6a7f6f3a8aed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:17.880260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1025-29f1-4add-a39f-6a7f6f3a8aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:17.969207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-640e1025-29f1-4add-a39f-6a7f6f3a8aed None None] MFA Rules not processed for user `158a2959940b40378234c1ae5e566c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:17.970490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-640e1025-29f1-4add-a39f-6a7f6f3a8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:18.089252 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 697/1399] 10.222.0.15 () {58 vars in 1040 bytes} [Thu Oct 6 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:15:18.099382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6c3fb-2f59-4d19-885f-cf97adecdcc2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:18.101015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8be6c3fb-2f59-4d19-885f-cf97adecdcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:18.263874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6c3fb-2f59-4d19-885f-cf97adecdcc2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:18.267073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:18.379465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d59cb-d10f-40a4-a752-77f00d69a582 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:18.380296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d59cb-d10f-40a4-a752-77f00d69a582 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:18.380584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d59cb-d10f-40a4-a752-77f00d69a582 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:18.380893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d59cb-d10f-40a4-a752-77f00d69a582 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:18.383093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-508d59cb-d10f-40a4-a752-77f00d69a582 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:18.481140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d59cb-d10f-40a4-a752-77f00d69a582 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:18.482958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d59cb-d10f-40a4-a752-77f00d69a582 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:18.491565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 703/1400] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:15:19.877131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbca2b-4c35-4ff0-99c5-d66faf43f03c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:19.877724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbca2b-4c35-4ff0-99c5-d66faf43f03c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:19.877724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbca2b-4c35-4ff0-99c5-d66faf43f03c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:19.879263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 698/1401] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:19.884690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384aae9-70a3-4560-8466-1a6b316477de None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:19.885192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384aae9-70a3-4560-8466-1a6b316477de None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:19.885293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384aae9-70a3-4560-8466-1a6b316477de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:19.941458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:19.968958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e384aae9-70a3-4560-8466-1a6b316477de None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:19.970301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e384aae9-70a3-4560-8466-1a6b316477de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:20.092657 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 704/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:20.395640 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbca2b-4c35-4ff0-99c5-d66faf43f03c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:20.398297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-45cbca2b-4c35-4ff0-99c5-d66faf43f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:20.411078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:20.635344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbca2b-4c35-4ff0-99c5-d66faf43f03c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:20.731527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:20.774518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23d1a-ad99-4187-ad36-933257529e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:20.775532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23d1a-ad99-4187-ad36-933257529e2e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:20.775822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23d1a-ad99-4187-ad36-933257529e2e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:20.776096 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23d1a-ad99-4187-ad36-933257529e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:20.777831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f2c23d1a-ad99-4187-ad36-933257529e2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:20.887552 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23d1a-ad99-4187-ad36-933257529e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:20.892345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23d1a-ad99-4187-ad36-933257529e2e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:20.911515 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 699/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:23.202502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795aa68-3522-4ca9-b807-5ae1ddc60c94 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:23.203062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795aa68-3522-4ca9-b807-5ae1ddc60c94 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:23.203062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795aa68-3522-4ca9-b807-5ae1ddc60c94 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:23.204387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 705/1404] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:23.210153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb173-d364-440a-a3fb-65619a5dfbe9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:23.210742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb173-d364-440a-a3fb-65619a5dfbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:23.210742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb173-d364-440a-a3fb-65619a5dfbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:23.287940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-107cb173-d364-440a-a3fb-65619a5dfbe9 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:23.289222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-107cb173-d364-440a-a3fb-65619a5dfbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:23.342817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:23.422562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 700/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:23.717881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795aa68-3522-4ca9-b807-5ae1ddc60c94 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:23.719424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c795aa68-3522-4ca9-b807-5ae1ddc60c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:23.876378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:23.934161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795aa68-3522-4ca9-b807-5ae1ddc60c94 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:24.077717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea83ca7-4a11-4ea7-8796-512964807f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:24.078222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83ca7-4a11-4ea7-8796-512964807f4c service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:24.078500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83ca7-4a11-4ea7-8796-512964807f4c service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:24.078772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea83ca7-4a11-4ea7-8796-512964807f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:24.080624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8ea83ca7-4a11-4ea7-8796-512964807f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:24.191109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:24.209763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea83ca7-4a11-4ea7-8796-512964807f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:24.211504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea83ca7-4a11-4ea7-8796-512964807f4c service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:24.232951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 706/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:26.614156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70ffd7-962a-415b-8e73-f0bf7fabee4e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:26.614728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70ffd7-962a-415b-8e73-f0bf7fabee4e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:26.614728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70ffd7-962a-415b-8e73-f0bf7fabee4e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:26.616114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 701/1407] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:26.621817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65928-ba61-415e-9fc9-abf75ba581fd None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:26.622686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65928-ba61-415e-9fc9-abf75ba581fd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:26.623121 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65928-ba61-415e-9fc9-abf75ba581fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:26.709409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8ed65928-ba61-415e-9fc9-abf75ba581fd None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:26.710806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8ed65928-ba61-415e-9fc9-abf75ba581fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:26.874295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 707/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:27.191304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70ffd7-962a-415b-8e73-f0bf7fabee4e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:27.194634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e70ffd7-962a-415b-8e73-f0bf7fabee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:27.391671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70ffd7-962a-415b-8e73-f0bf7fabee4e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:27.421733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:27.547255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348a2bb-3e2a-4227-83ed-8b54f7994d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:27.547255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a2bb-3e2a-4227-83ed-8b54f7994d69 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:27.547255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a2bb-3e2a-4227-83ed-8b54f7994d69 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:27.547255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a2bb-3e2a-4227-83ed-8b54f7994d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:27.548088 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0348a2bb-3e2a-4227-83ed-8b54f7994d69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:27.659522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348a2bb-3e2a-4227-83ed-8b54f7994d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:27.661204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348a2bb-3e2a-4227-83ed-8b54f7994d69 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:27.683458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 702/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:36.870657 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=77 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:37.680326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:41.926664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2294e40-5826-4dc0-96d2-599350e45995 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:41.927240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2294e40-5826-4dc0-96d2-599350e45995 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:41.927240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2294e40-5826-4dc0-96d2-599350e45995 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:41.928564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 708/1410] 10.222.0.15 () {54 vars in 918 bytes} [Thu Oct 6 12:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:41.934654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6c4f-d916-4ed5-9eb9-65d2de92250d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:41.935074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6c4f-d916-4ed5-9eb9-65d2de92250d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:41.935197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6c4f-d916-4ed5-9eb9-65d2de92250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:42.014112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f5ea6c4f-d916-4ed5-9eb9-65d2de92250d None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:42.015350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f5ea6c4f-d916-4ed5-9eb9-65d2de92250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:42.136268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 703/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Oct 6 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:42.152090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749813-fba1-499f-9e10-73854b94f134 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:42.152366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749813-fba1-499f-9e10-73854b94f134 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:42.152639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749813-fba1-499f-9e10-73854b94f134 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:42.154092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 709/1412] 10.222.0.15 () {54 vars in 918 bytes} [Thu Oct 6 12:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:42.160120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562bcd-5921-4ab0-9e45-6e67fd66c50d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:42.160415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562bcd-5921-4ab0-9e45-6e67fd66c50d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:42.160694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562bcd-5921-4ab0-9e45-6e67fd66c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:42.237494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:42.241610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-37562bcd-5921-4ab0-9e45-6e67fd66c50d None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:42.243132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-37562bcd-5921-4ab0-9e45-6e67fd66c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:42.369646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 704/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Oct 6 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:45.037060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1f6d-f464-4961-a2e3-b99890b900c8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:45.037676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1f6d-f464-4961-a2e3-b99890b900c8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:45.037788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1f6d-f464-4961-a2e3-b99890b900c8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:45.039073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:45.044899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad523e-9e35-4090-9f5e-86b16944bf6e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:45.045413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad523e-9e35-4090-9f5e-86b16944bf6e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:45.045530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad523e-9e35-4090-9f5e-86b16944bf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:45.115764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-52ad523e-9e35-4090-9f5e-86b16944bf6e None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:45.116997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-52ad523e-9e35-4090-9f5e-86b16944bf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:45.174324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:45.219143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:15:45.514221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa1f6d-f464-4961-a2e3-b99890b900c8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:45.515880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-93aa1f6d-f464-4961-a2e3-b99890b900c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:45.667027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa1f6d-f464-4961-a2e3-b99890b900c8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:45.744114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:45.789081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5659bc-bc98-4ad4-ab5b-64156ccbf035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:45.789635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5659bc-bc98-4ad4-ab5b-64156ccbf035 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:45.789916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5659bc-bc98-4ad4-ab5b-64156ccbf035 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:45.790189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5659bc-bc98-4ad4-ab5b-64156ccbf035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:45.791833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9e5659bc-bc98-4ad4-ab5b-64156ccbf035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:45.890623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5659bc-bc98-4ad4-ab5b-64156ccbf035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:45.892815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5659bc-bc98-4ad4-ab5b-64156ccbf035 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:45.912012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 711/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:47.093816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217fe40-b860-4a13-874c-ebd2e1c26edd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:47.094366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217fe40-b860-4a13-874c-ebd2e1c26edd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:47.094366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217fe40-b860-4a13-874c-ebd2e1c26edd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:47.095891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:47.102340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c162-b463-42f0-bc71-87d8d970b450 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:47.102848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c162-b463-42f0-bc71-87d8d970b450 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:47.102978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c162-b463-42f0-bc71-87d8d970b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:47.183593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7439c162-b463-42f0-bc71-87d8d970b450 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:47.184819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7439c162-b463-42f0-bc71-87d8d970b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:47.212892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:47.286537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:47.440754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217fe40-b860-4a13-874c-ebd2e1c26edd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:47.442404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e217fe40-b860-4a13-874c-ebd2e1c26edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:47.612943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217fe40-b860-4a13-874c-ebd2e1c26edd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:47.657023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:47.735256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11874de8-ff37-43fa-ab37-6101fcef36b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:47.737992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874de8-ff37-43fa-ab37-6101fcef36b5 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:47.737992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874de8-ff37-43fa-ab37-6101fcef36b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:47.737992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874de8-ff37-43fa-ab37-6101fcef36b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:47.737992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-11874de8-ff37-43fa-ab37-6101fcef36b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:47.834220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11874de8-ff37-43fa-ab37-6101fcef36b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:47.835828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11874de8-ff37-43fa-ab37-6101fcef36b5 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:47.860465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 707/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:49.027247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f3ba-c21f-4733-8930-b7de06fd9cd6 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:49.027828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f3ba-c21f-4733-8930-b7de06fd9cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:49.027828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f3ba-c21f-4733-8930-b7de06fd9cd6 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:49.029177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:49.035946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b063b41-7db9-4ea0-949f-6e6cb9b24ad0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:49.036449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b063b41-7db9-4ea0-949f-6e6cb9b24ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:49.036577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b063b41-7db9-4ea0-949f-6e6cb9b24ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:49.092986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:49.116278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2b063b41-7db9-4ea0-949f-6e6cb9b24ad0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:49.117496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b063b41-7db9-4ea0-949f-6e6cb9b24ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:49.216231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:49.368135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0f3ba-c21f-4733-8930-b7de06fd9cd6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:49.370385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e2b0f3ba-c21f-4733-8930-b7de06fd9cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:49.525293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0f3ba-c21f-4733-8930-b7de06fd9cd6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:49.537950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:49.644740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11e84-1a16-4d7d-8ed8-0bdd7641f7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:49.645340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11e84-1a16-4d7d-8ed8-0bdd7641f7ec service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:49.645644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11e84-1a16-4d7d-8ed8-0bdd7641f7ec service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:49.645919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11e84-1a16-4d7d-8ed8-0bdd7641f7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:49.647533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d2d11e84-1a16-4d7d-8ed8-0bdd7641f7ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:49.741859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11e84-1a16-4d7d-8ed8-0bdd7641f7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:49.743469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11e84-1a16-4d7d-8ed8-0bdd7641f7ec service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:49.764611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 714/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:50.902027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c515a-ca8e-4ed8-a720-4f3fa3071097 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:50.902623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c515a-ca8e-4ed8-a720-4f3fa3071097 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:50.902623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c515a-ca8e-4ed8-a720-4f3fa3071097 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:50.903899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:50.910700 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c21d-3162-4158-a2de-61568167b978 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:50.911220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c21d-3162-4158-a2de-61568167b978 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:50.911314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c21d-3162-4158-a2de-61568167b978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:50.931451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:50.992620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c694c21d-3162-4158-a2de-61568167b978 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:50.994261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c694c21d-3162-4158-a2de-61568167b978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:51.098447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:51.260065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c515a-ca8e-4ed8-a720-4f3fa3071097 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:51.262154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-020c515a-ca8e-4ed8-a720-4f3fa3071097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:51.378797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:51.422256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c515a-ca8e-4ed8-a720-4f3fa3071097 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:51.542263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26fa1-185e-44be-9c50-ced08381f7e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:51.542783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26fa1-185e-44be-9c50-ced08381f7e9 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:51.543064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26fa1-185e-44be-9c50-ced08381f7e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:51.543336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26fa1-185e-44be-9c50-ced08381f7e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:51.544963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cde26fa1-185e-44be-9c50-ced08381f7e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:51.628636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:51.642953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde26fa1-185e-44be-9c50-ced08381f7e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:51.644557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde26fa1-185e-44be-9c50-ced08381f7e9 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:51.664227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 710/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:52.812263 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264a4b-074a-4f04-9f9a-bb09283ac6d3 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:52.812862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264a4b-074a-4f04-9f9a-bb09283ac6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:52.812862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264a4b-074a-4f04-9f9a-bb09283ac6d3 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:52.814193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:52.820933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0ef2a-4102-460f-9a5c-958223356c98 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:52.821453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0ef2a-4102-460f-9a5c-958223356c98 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:52.821608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0ef2a-4102-460f-9a5c-958223356c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:52.900055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c3c0ef2a-4102-460f-9a5c-958223356c98 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:52.901850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3c0ef2a-4102-460f-9a5c-958223356c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:53.001939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:53.160682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264a4b-074a-4f04-9f9a-bb09283ac6d3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:53.162232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-41264a4b-074a-4f04-9f9a-bb09283ac6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:53.252151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:53.317546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264a4b-074a-4f04-9f9a-bb09283ac6d3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:53.436913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812d378-87d0-4f68-ac29-90875baff577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:53.437436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d378-87d0-4f68-ac29-90875baff577 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:53.437745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d378-87d0-4f68-ac29-90875baff577 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:53.438017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d378-87d0-4f68-ac29-90875baff577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:53.439627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1812d378-87d0-4f68-ac29-90875baff577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:53.493489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:53.536724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812d378-87d0-4f68-ac29-90875baff577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:53.538380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812d378-87d0-4f68-ac29-90875baff577 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:53.557643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 717/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:54.708776 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b7fa-336b-449b-80e6-eaf457fca275 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:54.709426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b7fa-336b-449b-80e6-eaf457fca275 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:54.709426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b7fa-336b-449b-80e6-eaf457fca275 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:54.710826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:54.718669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ef6a8-22d1-4a67-8ec9-e9979d8fa3c7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:54.719347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ef6a8-22d1-4a67-8ec9-e9979d8fa3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:54.719347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ef6a8-22d1-4a67-8ec9-e9979d8fa3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:54.800854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-170ef6a8-22d1-4a67-8ec9-e9979d8fa3c7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:54.802132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-170ef6a8-22d1-4a67-8ec9-e9979d8fa3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:54.913394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:55.070533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b7fa-336b-449b-80e6-eaf457fca275 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:55.071970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b8a0b7fa-336b-449b-80e6-eaf457fca275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:55.133452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:55.247943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b7fa-336b-449b-80e6-eaf457fca275 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:55.375627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aa4c0-72c7-4491-89a8-1be7546c911f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:55.376152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa4c0-72c7-4491-89a8-1be7546c911f service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:55.376435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa4c0-72c7-4491-89a8-1be7546c911f service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:55.376711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa4c0-72c7-4491-89a8-1be7546c911f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:55.378380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-793aa4c0-72c7-4491-89a8-1be7546c911f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:55.385559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:55.474163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aa4c0-72c7-4491-89a8-1be7546c911f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:55.475781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aa4c0-72c7-4491-89a8-1be7546c911f service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:55.495375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 713/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:56.579391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93008e29-316f-45c8-9e14-1b769e12ecee None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:56.579930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93008e29-316f-45c8-9e14-1b769e12ecee None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:56.579930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93008e29-316f-45c8-9e14-1b769e12ecee None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:56.581180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:56.587565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bd18-dc42-42f0-be52-f6940c28a6d9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:56.588028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bd18-dc42-42f0-be52-f6940c28a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:56.588137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bd18-dc42-42f0-be52-f6940c28a6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:56.663361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5567bd18-dc42-42f0-be52-f6940c28a6d9 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:56.664571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5567bd18-dc42-42f0-be52-f6940c28a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:56.732678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:56.761752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:56.911805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93008e29-316f-45c8-9e14-1b769e12ecee None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:56.913314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-93008e29-316f-45c8-9e14-1b769e12ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:56.930502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:57.061832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93008e29-316f-45c8-9e14-1b769e12ecee None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:57.156336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:57.186009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23da3-779d-4086-8651-60f8f357474a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:57.186533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23da3-779d-4086-8651-60f8f357474a service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:57.186801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23da3-779d-4086-8651-60f8f357474a service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:57.187070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23da3-779d-4086-8651-60f8f357474a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:57.188721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-26f23da3-779d-4086-8651-60f8f357474a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:57.281005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23da3-779d-4086-8651-60f8f357474a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:57.282687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23da3-779d-4086-8651-60f8f357474a service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:57.300571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 720/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:15:58.405007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809394c7-200f-4a10-b37a-c54a3479a67b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:58.405564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809394c7-200f-4a10-b37a-c54a3479a67b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:58.405564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809394c7-200f-4a10-b37a-c54a3479a67b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:58.406834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:15:58.413012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580667-c732-44e6-af03-ebea3991c469 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:58.413434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580667-c732-44e6-af03-ebea3991c469 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:58.413600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580667-c732-44e6-af03-ebea3991c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:58.490287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-58580667-c732-44e6-af03-ebea3991c469 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:15:58.491493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-58580667-c732-44e6-af03-ebea3991c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:58.534184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:58.591976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:15:58.748300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809394c7-200f-4a10-b37a-c54a3479a67b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:15:58.749747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-809394c7-200f-4a10-b37a-c54a3479a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:58.893482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809394c7-200f-4a10-b37a-c54a3479a67b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:15:58.948676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:15:59.009770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352a713-1869-4497-a3e0-78be676c2f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:15:59.010296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352a713-1869-4497-a3e0-78be676c2f73 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:15:59.010581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352a713-1869-4497-a3e0-78be676c2f73 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:15:59.010856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352a713-1869-4497-a3e0-78be676c2f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:15:59.012488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d352a713-1869-4497-a3e0-78be676c2f73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:15:59.101902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352a713-1869-4497-a3e0-78be676c2f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:15:59.103494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352a713-1869-4497-a3e0-78be676c2f73 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:15:59.121947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 716/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:00.192003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7441c-8ad9-4da2-8ef1-2ab0b115b69b None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:00.192573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7441c-8ad9-4da2-8ef1-2ab0b115b69b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:00.192573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7441c-8ad9-4da2-8ef1-2ab0b115b69b None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:00.193938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:00.200994 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d6fe-73e5-4ba5-8a29-c21d5ae18603 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:00.201562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d6fe-73e5-4ba5-8a29-c21d5ae18603 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:00.201692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d6fe-73e5-4ba5-8a29-c21d5ae18603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:00.281582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4e98d6fe-73e5-4ba5-8a29-c21d5ae18603 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:00.282807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4e98d6fe-73e5-4ba5-8a29-c21d5ae18603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:00.284902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:00.382844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:00.541563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7441c-8ad9-4da2-8ef1-2ab0b115b69b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:00.543913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f3f7441c-8ad9-4da2-8ef1-2ab0b115b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:00.695959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7441c-8ad9-4da2-8ef1-2ab0b115b69b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:00.725518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:00.814330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851c7a5-1bab-4b2a-ae34-f6f50e6fc51f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:00.814937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851c7a5-1bab-4b2a-ae34-f6f50e6fc51f service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:00.815213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851c7a5-1bab-4b2a-ae34-f6f50e6fc51f service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:00.815483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851c7a5-1bab-4b2a-ae34-f6f50e6fc51f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:00.817097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7851c7a5-1bab-4b2a-ae34-f6f50e6fc51f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:00.917082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851c7a5-1bab-4b2a-ae34-f6f50e6fc51f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:00.918857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851c7a5-1bab-4b2a-ae34-f6f50e6fc51f service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:00.937487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 723/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:03.042966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b856b-99e5-42fc-80f5-2459dd7be803 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:03.043529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b856b-99e5-42fc-80f5-2459dd7be803 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:03.043529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b856b-99e5-42fc-80f5-2459dd7be803 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:03.044884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:03.050696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10927e8a-2a54-4ace-93d0-9a9704785569 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:03.051191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10927e8a-2a54-4ace-93d0-9a9704785569 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:03.051287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10927e8a-2a54-4ace-93d0-9a9704785569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:03.095761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:03.123131 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-10927e8a-2a54-4ace-93d0-9a9704785569 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:03.124350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-10927e8a-2a54-4ace-93d0-9a9704785569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:03.226677 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:03.520786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b856b-99e5-42fc-80f5-2459dd7be803 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:03.522400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-063b856b-99e5-42fc-80f5-2459dd7be803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:03.631395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b856b-99e5-42fc-80f5-2459dd7be803 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:03.664652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:03.712632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269a8a8-eba5-45f1-a93c-1c57924e7f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:03.713227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a8a8-eba5-45f1-a93c-1c57924e7f21 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:03.713527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a8a8-eba5-45f1-a93c-1c57924e7f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:03.713978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a8a8-eba5-45f1-a93c-1c57924e7f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:03.715659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2269a8a8-eba5-45f1-a93c-1c57924e7f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:03.833614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269a8a8-eba5-45f1-a93c-1c57924e7f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:03.834959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269a8a8-eba5-45f1-a93c-1c57924e7f21 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:03.853918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 719/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:06.235384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d962a-8696-4bfe-8650-04d5f3695216 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:06.236195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d962a-8696-4bfe-8650-04d5f3695216 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:06.236195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d962a-8696-4bfe-8650-04d5f3695216 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:06.237287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:06.242968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362220f-5ac9-4cbf-b9d2-f59d90ab3860 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:06.243461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362220f-5ac9-4cbf-b9d2-f59d90ab3860 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:06.243565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362220f-5ac9-4cbf-b9d2-f59d90ab3860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:06.319207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1362220f-5ac9-4cbf-b9d2-f59d90ab3860 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:06.320443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1362220f-5ac9-4cbf-b9d2-f59d90ab3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:06.337968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:06.426754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:16:06.724812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d962a-8696-4bfe-8650-04d5f3695216 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:06.726493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ab8d962a-8696-4bfe-8650-04d5f3695216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:06.833874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d962a-8696-4bfe-8650-04d5f3695216 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:06.847266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:06.911539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb4975-ed09-4533-aba1-7258f7a743d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:06.912148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb4975-ed09-4533-aba1-7258f7a743d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:06.912428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb4975-ed09-4533-aba1-7258f7a743d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:06.912699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb4975-ed09-4533-aba1-7258f7a743d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:06.914367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2dbb4975-ed09-4533-aba1-7258f7a743d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:07.030900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb4975-ed09-4533-aba1-7258f7a743d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:07.032267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb4975-ed09-4533-aba1-7258f7a743d2 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:07.052887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 726/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:09.644160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd37da0-ddde-4fc3-8bbb-5a91252cdf7a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:09.644712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd37da0-ddde-4fc3-8bbb-5a91252cdf7a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:09.644712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd37da0-ddde-4fc3-8bbb-5a91252cdf7a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:09.646180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:09.652428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bbd1-a030-420d-9295-bec00262162f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:09.652976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bbd1-a030-420d-9295-bec00262162f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:09.652976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bbd1-a030-420d-9295-bec00262162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:09.703888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:09.723333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e572bbd1-a030-420d-9295-bec00262162f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:09.724549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e572bbd1-a030-420d-9295-bec00262162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:09.830072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:10.118855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd37da0-ddde-4fc3-8bbb-5a91252cdf7a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:10.120475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9cd37da0-ddde-4fc3-8bbb-5a91252cdf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:10.235086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd37da0-ddde-4fc3-8bbb-5a91252cdf7a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:10.279473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:10.316149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c7f6-e7e5-4827-b3e0-2101304a2723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:10.316757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c7f6-e7e5-4827-b3e0-2101304a2723 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:10.317038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c7f6-e7e5-4827-b3e0-2101304a2723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:10.317306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c7f6-e7e5-4827-b3e0-2101304a2723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:10.318972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3469c7f6-e7e5-4827-b3e0-2101304a2723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:10.439313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c7f6-e7e5-4827-b3e0-2101304a2723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:10.440755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c7f6-e7e5-4827-b3e0-2101304a2723 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:10.461206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 722/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:12.835717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6127d2-4502-46dc-b037-65f24209183c None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:12.836303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6127d2-4502-46dc-b037-65f24209183c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:12.836303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6127d2-4502-46dc-b037-65f24209183c None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:12.837646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:12.843278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ebaea-2abe-4321-8ffe-8cd5d2110ea0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:12.843785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ebaea-2abe-4321-8ffe-8cd5d2110ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:12.843880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ebaea-2abe-4321-8ffe-8cd5d2110ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:12.912460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9c2ebaea-2abe-4321-8ffe-8cd5d2110ea0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:12.913718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c2ebaea-2abe-4321-8ffe-8cd5d2110ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:12.935099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:13.016674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:13.302103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6127d2-4502-46dc-b037-65f24209183c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:13.303639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9d6127d2-4502-46dc-b037-65f24209183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:13.424439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6127d2-4502-46dc-b037-65f24209183c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:13.446652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:13.505159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07790bc1-2659-481c-9fd0-a0b7c2d5cd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:13.505794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790bc1-2659-481c-9fd0-a0b7c2d5cd52 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:13.506082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790bc1-2659-481c-9fd0-a0b7c2d5cd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:13.506357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790bc1-2659-481c-9fd0-a0b7c2d5cd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:13.508035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-07790bc1-2659-481c-9fd0-a0b7c2d5cd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:13.627388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07790bc1-2659-481c-9fd0-a0b7c2d5cd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:13.628856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07790bc1-2659-481c-9fd0-a0b7c2d5cd52 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:13.649179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 729/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:15.953038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197549e0-b865-4ef0-bd2d-575ff42d6518 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:15.953636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197549e0-b865-4ef0-bd2d-575ff42d6518 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:15.953636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197549e0-b865-4ef0-bd2d-575ff42d6518 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:15.955003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:15.960604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c05731-b57b-4cc3-83ac-4bc7f232bbe2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:15.961090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c05731-b57b-4cc3-83ac-4bc7f232bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:15.961189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c05731-b57b-4cc3-83ac-4bc7f232bbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:16.032429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:16.035488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b7c05731-b57b-4cc3-83ac-4bc7f232bbe2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:16.037261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b7c05731-b57b-4cc3-83ac-4bc7f232bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:16.144960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:16.442893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197549e0-b865-4ef0-bd2d-575ff42d6518 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:16.444444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-197549e0-b865-4ef0-bd2d-575ff42d6518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:16.547391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197549e0-b865-4ef0-bd2d-575ff42d6518 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:16.597917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:16.622810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186df0c9-76cc-4467-b6d3-3f8999f850c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:16.623430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186df0c9-76cc-4467-b6d3-3f8999f850c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:16.623714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186df0c9-76cc-4467-b6d3-3f8999f850c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:16.623990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186df0c9-76cc-4467-b6d3-3f8999f850c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:16.625628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-186df0c9-76cc-4467-b6d3-3f8999f850c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:16.738972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186df0c9-76cc-4467-b6d3-3f8999f850c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:16.740375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186df0c9-76cc-4467-b6d3-3f8999f850c0 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:16.758017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 725/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:19.041327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dbf7c-233c-4cde-8265-41b7ba725287 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:19.041933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dbf7c-233c-4cde-8265-41b7ba725287 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:19.041933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dbf7c-233c-4cde-8265-41b7ba725287 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:19.043973 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:19.049480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1a07-b06a-4b60-ab9d-3846d9bac1d4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:19.049956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1a07-b06a-4b60-ab9d-3846d9bac1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:19.050067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1a07-b06a-4b60-ab9d-3846d9bac1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:19.116842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-892e1a07-b06a-4b60-ab9d-3846d9bac1d4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:19.118318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-892e1a07-b06a-4b60-ab9d-3846d9bac1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:19.148908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:19.216963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:19.505283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dbf7c-233c-4cde-8265-41b7ba725287 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:19.506909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7d6dbf7c-233c-4cde-8265-41b7ba725287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:19.620836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dbf7c-233c-4cde-8265-41b7ba725287 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:19.651033 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:19.700205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5226b-baed-4c6b-a208-e6b2bc3e7ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:19.700808 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5226b-baed-4c6b-a208-e6b2bc3e7ecb service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:19.701085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5226b-baed-4c6b-a208-e6b2bc3e7ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:19.701351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5226b-baed-4c6b-a208-e6b2bc3e7ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:19.703286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0ad5226b-baed-4c6b-a208-e6b2bc3e7ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:19.815123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5226b-baed-4c6b-a208-e6b2bc3e7ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:19.816468 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5226b-baed-4c6b-a208-e6b2bc3e7ecb service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:19.835330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 732/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:22.060413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa433c-a8e6-431c-b07f-c5a8954ddc0a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:22.061081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa433c-a8e6-431c-b07f-c5a8954ddc0a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:22.061081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa433c-a8e6-431c-b07f-c5a8954ddc0a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:22.062326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:22.067871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3c53-95a4-4e1f-9707-7103b62b6f3c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:22.068334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3c53-95a4-4e1f-9707-7103b62b6f3c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:22.068446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3c53-95a4-4e1f-9707-7103b62b6f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:22.146253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a9ca3c53-95a4-4e1f-9707-7103b62b6f3c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:22.147518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a9ca3c53-95a4-4e1f-9707-7103b62b6f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:22.158146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:22.273260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:22.563494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa433c-a8e6-431c-b07f-c5a8954ddc0a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:22.565091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d9fa433c-a8e6-431c-b07f-c5a8954ddc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:22.670158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa433c-a8e6-431c-b07f-c5a8954ddc0a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:22.726469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:22.744427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73637818-e3f3-47cc-beba-c6c25131847c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:22.745035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73637818-e3f3-47cc-beba-c6c25131847c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:22.745319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73637818-e3f3-47cc-beba-c6c25131847c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:22.746118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73637818-e3f3-47cc-beba-c6c25131847c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:22.747874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-73637818-e3f3-47cc-beba-c6c25131847c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:22.858835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73637818-e3f3-47cc-beba-c6c25131847c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:22.860215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73637818-e3f3-47cc-beba-c6c25131847c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:22.996652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 728/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:25.245977 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a19e0-d33d-400b-9b9f-308167c8b322 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:25.246747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a19e0-d33d-400b-9b9f-308167c8b322 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:25.246747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a19e0-d33d-400b-9b9f-308167c8b322 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:25.247853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:25.253114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3a2f-5cd5-47dd-9f64-91d13c600470 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:25.253590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3a2f-5cd5-47dd-9f64-91d13c600470 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:25.253702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3a2f-5cd5-47dd-9f64-91d13c600470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:25.320114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a02b3a2f-5cd5-47dd-9f64-91d13c600470 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:25.321341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a02b3a2f-5cd5-47dd-9f64-91d13c600470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:25.361822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:25.420180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:25.706738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a19e0-d33d-400b-9b9f-308167c8b322 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:25.708277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-265a19e0-d33d-400b-9b9f-308167c8b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:25.817748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a19e0-d33d-400b-9b9f-308167c8b322 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:25.857653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:25.895439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054d1ec-dba2-430d-83e2-77df374d6882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:25.896051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d1ec-dba2-430d-83e2-77df374d6882 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:25.896330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d1ec-dba2-430d-83e2-77df374d6882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:25.896602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d1ec-dba2-430d-83e2-77df374d6882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:25.898266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b054d1ec-dba2-430d-83e2-77df374d6882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:26.014526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054d1ec-dba2-430d-83e2-77df374d6882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:26.015894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054d1ec-dba2-430d-83e2-77df374d6882 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:26.035281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 735/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:28.294709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae78fb-a9ba-45f0-ac9a-acd290394b81 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:28.295272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae78fb-a9ba-45f0-ac9a-acd290394b81 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:28.295272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae78fb-a9ba-45f0-ac9a-acd290394b81 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:28.296567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:28.301925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6a74-019c-428f-ba5b-95bac058a5e1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:28.302353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6a74-019c-428f-ba5b-95bac058a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:28.302477 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6a74-019c-428f-ba5b-95bac058a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:28.368847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-073b6a74-019c-428f-ba5b-95bac058a5e1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:28.370102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-073b6a74-019c-428f-ba5b-95bac058a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:28.389117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:28.474245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:16:28.760233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae78fb-a9ba-45f0-ac9a-acd290394b81 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:28.762669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1aae78fb-a9ba-45f0-ac9a-acd290394b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:28.864588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae78fb-a9ba-45f0-ac9a-acd290394b81 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:28.931431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:28.938904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c37b13-2d3c-43ba-888b-faa7e70ae1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:28.939505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c37b13-2d3c-43ba-888b-faa7e70ae1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:28.939786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c37b13-2d3c-43ba-888b-faa7e70ae1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:28.940059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c37b13-2d3c-43ba-888b-faa7e70ae1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:28.941687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9c37b13-2d3c-43ba-888b-faa7e70ae1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:29.057681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c37b13-2d3c-43ba-888b-faa7e70ae1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:29.059619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c37b13-2d3c-43ba-888b-faa7e70ae1d2 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:29.077261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 731/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:31.226427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551b052-41fe-45da-8ad0-81fd63614491 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:31.226995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551b052-41fe-45da-8ad0-81fd63614491 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:31.226995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551b052-41fe-45da-8ad0-81fd63614491 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:31.228357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:31.234345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5429-a9eb-454a-ade3-71fe23a2718c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:31.234785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5429-a9eb-454a-ade3-71fe23a2718c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:31.234885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5429-a9eb-454a-ade3-71fe23a2718c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:31.299583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3c7a5429-a9eb-454a-ade3-71fe23a2718c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:31.300781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3c7a5429-a9eb-454a-ade3-71fe23a2718c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:31.347358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:31.398565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:31.680980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551b052-41fe-45da-8ad0-81fd63614491 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:31.682560 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e551b052-41fe-45da-8ad0-81fd63614491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:31.792485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551b052-41fe-45da-8ad0-81fd63614491 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:31.842162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:31.867352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc45d8-6198-4354-9607-6bca505177f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:31.867952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc45d8-6198-4354-9607-6bca505177f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:31.868228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc45d8-6198-4354-9607-6bca505177f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:31.868494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc45d8-6198-4354-9607-6bca505177f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:31.870096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-61fc45d8-6198-4354-9607-6bca505177f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:31.979427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc45d8-6198-4354-9607-6bca505177f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:31.980813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc45d8-6198-4354-9607-6bca505177f3 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:31.999000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 738/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:16:41.397030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=22 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:41.996920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=66 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:52.085235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f314dc4-c185-4a0e-981e-8045aee7f868 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:52.085838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f314dc4-c185-4a0e-981e-8045aee7f868 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:52.085838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f314dc4-c185-4a0e-981e-8045aee7f868 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:52.087138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 733/1471] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:52.093383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0e8f-8ef1-4544-a4da-8c4e2bfda495 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:52.093880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0e8f-8ef1-4544-a4da-8c4e2bfda495 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:52.093996 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0e8f-8ef1-4544-a4da-8c4e2bfda495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:52.162531 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-de4b0e8f-8ef1-4544-a4da-8c4e2bfda495 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:52.163727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-de4b0e8f-8ef1-4544-a4da-8c4e2bfda495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:52.265049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 739/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:52.563059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1706-abeb-488a-9d43-34c97a331f31 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:52.563343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1706-abeb-488a-9d43-34c97a331f31 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:52.563620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1706-abeb-488a-9d43-34c97a331f31 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:52.564959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 734/1473] 10.222.0.15 () {54 vars in 962 bytes} [Thu Oct 6 12:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:52.569855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d63f6a-64ec-49eb-9dcd-dd1506e1959d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:52.570145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d63f6a-64ec-49eb-9dcd-dd1506e1959d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:52.570422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d63f6a-64ec-49eb-9dcd-dd1506e1959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:52.649836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-21d63f6a-64ec-49eb-9dcd-dd1506e1959d None None] MFA Rules not processed for user `945f11bdc38e4728a78449d99a0fcbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:52.651052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-21d63f6a-64ec-49eb-9dcd-dd1506e1959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:52.671533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:52.726462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 740/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Oct 6 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:52.734856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e1706-abeb-488a-9d43-34c97a331f31 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:52.736376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f03e1706-abeb-488a-9d43-34c97a331f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:52.837901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e1706-abeb-488a-9d43-34c97a331f31 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:52.911298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f5dea-b184-4fdb-8218-2941a92970bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:52.911894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5dea-b184-4fdb-8218-2941a92970bc service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:52.912173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5dea-b184-4fdb-8218-2941a92970bc service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:52.912442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5dea-b184-4fdb-8218-2941a92970bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:52.914061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d72f5dea-b184-4fdb-8218-2941a92970bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:52.967645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:53.025282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f5dea-b184-4fdb-8218-2941a92970bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:53.026742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f5dea-b184-4fdb-8218-2941a92970bc service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:53.046021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 735/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:16:55.343177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8447-3d4b-4c82-aa80-a2b4dcff7608 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:55.343768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8447-3d4b-4c82-aa80-a2b4dcff7608 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:55.343768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8447-3d4b-4c82-aa80-a2b4dcff7608 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:55.345078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 741/1476] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:55.350456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ee08e-bcca-47f0-bc55-3671d8a09932 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:55.350892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ee08e-bcca-47f0-bc55-3671d8a09932 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:55.351005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ee08e-bcca-47f0-bc55-3671d8a09932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:55.417074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-be8ee08e-bcca-47f0-bc55-3671d8a09932 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:55.418445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be8ee08e-bcca-47f0-bc55-3671d8a09932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:55.512690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 736/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:55.794983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd8447-3d4b-4c82-aa80-a2b4dcff7608 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:55.796436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a6cd8447-3d4b-4c82-aa80-a2b4dcff7608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:55.922219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd8447-3d4b-4c82-aa80-a2b4dcff7608 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:55.972862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:56.017410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c06d1-0536-41c4-a2be-ec88c01e5fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:56.018035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c06d1-0536-41c4-a2be-ec88c01e5fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:56.018306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c06d1-0536-41c4-a2be-ec88c01e5fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:56.018570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c06d1-0536-41c4-a2be-ec88c01e5fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:56.019214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c06d1-0536-41c4-a2be-ec88c01e5fb5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:56.021210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-4f9c06d1-0536-41c4-a2be-ec88c01e5fb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:16:56.021210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: warnings.warn(msg) Oct 06 12:16:56.021210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: Oct 06 12:16:56.022402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c06d1-0536-41c4-a2be-ec88c01e5fb5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:56.041069 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 742/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Oct 6 12:16:55 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:16:58.306840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d1344-cbde-4ac3-a2de-2b51fdf7eee4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:58.307503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d1344-cbde-4ac3-a2de-2b51fdf7eee4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:58.307503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d1344-cbde-4ac3-a2de-2b51fdf7eee4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:58.309058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 737/1479] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:16:58.314300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bcfe-d9e8-4c5b-9452-04bab5da406d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:58.314728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bcfe-d9e8-4c5b-9452-04bab5da406d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:58.314857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bcfe-d9e8-4c5b-9452-04bab5da406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:58.389789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b297bcfe-d9e8-4c5b-9452-04bab5da406d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:16:58.391322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b297bcfe-d9e8-4c5b-9452-04bab5da406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:58.491217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 743/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:16:58.790812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d1344-cbde-4ac3-a2de-2b51fdf7eee4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:16:58.794605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a81d1344-cbde-4ac3-a2de-2b51fdf7eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:58.804234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:58.939392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d1344-cbde-4ac3-a2de-2b51fdf7eee4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:16:59.019528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:16:59.057404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f3c79-d66b-4659-b1bb-7f9a0a774464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:16:59.057958 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3c79-d66b-4659-b1bb-7f9a0a774464 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:16:59.058245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3c79-d66b-4659-b1bb-7f9a0a774464 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:16:59.058527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3c79-d66b-4659-b1bb-7f9a0a774464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:16:59.060194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-964f3c79-d66b-4659-b1bb-7f9a0a774464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:16:59.150488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f3c79-d66b-4659-b1bb-7f9a0a774464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:16:59.152118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f3c79-d66b-4659-b1bb-7f9a0a774464 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:16:59.170957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 738/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:17:01.533558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19ba06-3067-4166-a064-98ba28982903 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:01.534121 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19ba06-3067-4166-a064-98ba28982903 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:01.534121 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19ba06-3067-4166-a064-98ba28982903 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:01.535457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 744/1482] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:17:01.540978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ac105-fcea-46b5-b159-b6c9eb8dbe4f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:01.541405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ac105-fcea-46b5-b159-b6c9eb8dbe4f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:01.541529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ac105-fcea-46b5-b159-b6c9eb8dbe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:01.607137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2a2ac105-fcea-46b5-b159-b6c9eb8dbe4f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:17:01.608323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2a2ac105-fcea-46b5-b159-b6c9eb8dbe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:01.653446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:01.703276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 739/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:17:01.988671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19ba06-3067-4166-a064-98ba28982903 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:17:01.990244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9e19ba06-3067-4166-a064-98ba28982903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:02.013736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:02.094445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19ba06-3067-4166-a064-98ba28982903 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:17:02.169370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144623-b91a-4aaf-aef8-8e017145bce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:17:02.170010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144623-b91a-4aaf-aef8-8e017145bce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:02.170284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144623-b91a-4aaf-aef8-8e017145bce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:02.170551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144623-b91a-4aaf-aef8-8e017145bce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:02.172143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-11144623-b91a-4aaf-aef8-8e017145bce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:02.246936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:02.282248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11144623-b91a-4aaf-aef8-8e017145bce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:17:02.283680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11144623-b91a-4aaf-aef8-8e017145bce1 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:17:02.421836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 745/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:17:04.664055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f5132-f119-4e7a-9316-1b994e6eb394 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:04.664700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f5132-f119-4e7a-9316-1b994e6eb394 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:04.664700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f5132-f119-4e7a-9316-1b994e6eb394 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:04.665982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 740/1485] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:17:04.672098 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fe96-17de-4856-baf9-79ff44f8d4b2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:04.672536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fe96-17de-4856-baf9-79ff44f8d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:04.672756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fe96-17de-4856-baf9-79ff44f8d4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:04.752032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0604fe96-17de-4856-baf9-79ff44f8d4b2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:17:04.753369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0604fe96-17de-4856-baf9-79ff44f8d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:04.858618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 746/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:17:05.162716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f5132-f119-4e7a-9316-1b994e6eb394 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:17:05.164253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b02f5132-f119-4e7a-9316-1b994e6eb394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:05.269268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f5132-f119-4e7a-9316-1b994e6eb394 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:17:05.348231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:05.349818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf75270-1133-46b3-acf9-b0c1fad6d97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:17:05.350475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75270-1133-46b3-acf9-b0c1fad6d97d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:05.350759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75270-1133-46b3-acf9-b0c1fad6d97d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:05.351171 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75270-1133-46b3-acf9-b0c1fad6d97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:05.353369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-caf75270-1133-46b3-acf9-b0c1fad6d97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:05.471760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf75270-1133-46b3-acf9-b0c1fad6d97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:17:05.473493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf75270-1133-46b3-acf9-b0c1fad6d97d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:17:05.493662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 741/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:17:07.780901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02d08a-4834-4fe7-8107-4ae1d3396642 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:07.781472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02d08a-4834-4fe7-8107-4ae1d3396642 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:07.781472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02d08a-4834-4fe7-8107-4ae1d3396642 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:07.782881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 747/1488] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:17:07.788493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2946a-b1bc-4bda-affa-b0b3e1a2bc99 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:07.788946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2946a-b1bc-4bda-affa-b0b3e1a2bc99 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:07.789049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2946a-b1bc-4bda-affa-b0b3e1a2bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:07.861060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5ac2946a-b1bc-4bda-affa-b0b3e1a2bc99 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:17:07.862340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5ac2946a-b1bc-4bda-affa-b0b3e1a2bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:07.917895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:07.964513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 742/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:17:08.261174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02d08a-4834-4fe7-8107-4ae1d3396642 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:17:08.263333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8f02d08a-4834-4fe7-8107-4ae1d3396642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:08.301746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:08.373410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02d08a-4834-4fe7-8107-4ae1d3396642 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:17:08.454367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f925ce2-5fc7-44d6-a4b8-2c15dda1ab31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:17:08.454907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f925ce2-5fc7-44d6-a4b8-2c15dda1ab31 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:08.455181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f925ce2-5fc7-44d6-a4b8-2c15dda1ab31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:08.455449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f925ce2-5fc7-44d6-a4b8-2c15dda1ab31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:08.457037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2f925ce2-5fc7-44d6-a4b8-2c15dda1ab31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:08.541175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:08.570745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f925ce2-5fc7-44d6-a4b8-2c15dda1ab31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:17:08.572139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f925ce2-5fc7-44d6-a4b8-2c15dda1ab31 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:17:08.590505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 748/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:17:10.987408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233823-f48e-4f23-94fc-3576f1377afa None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:10.987993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233823-f48e-4f23-94fc-3576f1377afa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:10.987993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233823-f48e-4f23-94fc-3576f1377afa None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:10.989352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 743/1491] 10.222.0.15 () {54 vars in 927 bytes} [Thu Oct 6 12:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:17:10.995292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba124-6cf6-44cd-aecd-f57e342e7504 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:10.995847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba124-6cf6-44cd-aecd-f57e342e7504 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:10.995963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba124-6cf6-44cd-aecd-f57e342e7504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:11.065126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-703ba124-6cf6-44cd-aecd-f57e342e7504 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:17:11.066370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-703ba124-6cf6-44cd-aecd-f57e342e7504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:11.170925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 749/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Oct 6 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:17:11.469418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13233823-f48e-4f23-94fc-3576f1377afa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:17:11.471017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-13233823-f48e-4f23-94fc-3576f1377afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:11.574324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13233823-f48e-4f23-94fc-3576f1377afa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:17:11.648305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c356397-3ca8-4874-b1b9-7665766db593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:17:11.648907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356397-3ca8-4874-b1b9-7665766db593 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:17:11.649187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356397-3ca8-4874-b1b9-7665766db593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:17:11.649458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356397-3ca8-4874-b1b9-7665766db593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:17:11.651140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4c356397-3ca8-4874-b1b9-7665766db593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:17:11.659807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:11.765755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c356397-3ca8-4874-b1b9-7665766db593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:17:11.767107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c356397-3ca8-4874-b1b9-7665766db593 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:17:11.792507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 744/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:17:21.168728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=82 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:17:21.788812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=50 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:26.598916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051a11-9130-4ced-a573-c223745c17b5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:26.599529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051a11-9130-4ced-a573-c223745c17b5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:26.599529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051a11-9130-4ced-a573-c223745c17b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:26.681715 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-db051a11-9130-4ced-a573-c223745c17b5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:18:26.682949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-db051a11-9130-4ced-a573-c223745c17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:26.787704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 750/1494] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:18:26.795917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504ad0-50ab-47fc-8028-338351fe8c27 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:26.796518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504ad0-50ab-47fc-8028-338351fe8c27 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:26.796619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504ad0-50ab-47fc-8028-338351fe8c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:26.876743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-28504ad0-50ab-47fc-8028-338351fe8c27 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:18:26.878001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-28504ad0-50ab-47fc-8028-338351fe8c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:26.974301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 745/1495] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:18:26.978969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db051a11-9130-4ced-a573-c223745c17b5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:26.980218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-db051a11-9130-4ced-a573-c223745c17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:26.991634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db051a11-9130-4ced-a573-c223745c17b5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:27.056392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:27.093225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:27.093863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:27.094187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:27.094405 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:27.095048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:18:27.095326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:27.096351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:18:27.096351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: warnings.warn(msg) Oct 06 12:18:27.096351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: Oct 06 12:18:27.097220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:27.109475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 751/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:18:27.117809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28504ad0-50ab-47fc-8028-338351fe8c27 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:27.127964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28504ad0-50ab-47fc-8028-338351fe8c27 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:27.190351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:27.223816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:27.224416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:27.224694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:27.224963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:27.225615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:27.227347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:18:27.227347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 06 12:18:27.227347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: Oct 06 12:18:27.228640 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:27.286487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 746/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:18:27 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:18:27.292423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:27.294821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:27.330152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2218fa-0213-4345-ac46-6bae62cf0613 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:27.423493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:27.423999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:27.424267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:27.424530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:27.425167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:27.426207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:18:27.426207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: warnings.warn(msg) Oct 06 12:18:27.426207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: Oct 06 12:18:27.427401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:27.477418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 752/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:18:27 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:18:27.483299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:27.485000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:27.552383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd103a8-3a94-41bd-85e1-4839e5615097 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:27.644266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:27.657721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:27.658408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:27.658754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:27.659053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:27.659769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:27.660940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:18:27.660940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 06 12:18:27.660940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: Oct 06 12:18:27.661967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:27.677336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 747/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:18:27.681456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:27.683020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:27.694366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09d1e3-ddce-4951-a451-c32abfa6ca73 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:27.720241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:27.793003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66948ad1-dd1d-48e9-b5f7-d0b6f3d6d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:27.793645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948ad1-dd1d-48e9-b5f7-d0b6f3d6d0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:27.793917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948ad1-dd1d-48e9-b5f7-d0b6f3d6d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:27.794182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948ad1-dd1d-48e9-b5f7-d0b6f3d6d0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:27.795374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66948ad1-dd1d-48e9-b5f7-d0b6f3d6d0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:27.796543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-66948ad1-dd1d-48e9-b5f7-d0b6f3d6d0d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:18:27.796543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: warnings.warn(msg) Oct 06 12:18:27.796543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: Oct 06 12:18:27.797430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66948ad1-dd1d-48e9-b5f7-d0b6f3d6d0d8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:27.810572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 753/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:18:27.814747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:27.816300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:27.852444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95fec2-bd58-406f-be12-163503fc1e42 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:27.947085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b8722-9c52-47cf-848e-43bb5edd5ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:27.947669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8722-9c52-47cf-848e-43bb5edd5ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:27.947948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8722-9c52-47cf-848e-43bb5edd5ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:27.948222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8722-9c52-47cf-848e-43bb5edd5ebd admin admin] PATH_INFO: `/v3/projects/5ff9f309897642219e43f3809234fe50/users/ae1eee81e2854f05ae9470df96612731/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:27.972009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b8722-9c52-47cf-848e-43bb5edd5ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff9f309897642219e43f3809234fe50, user_id=ae1eee81e2854f05ae9470df96612731, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:27.973042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-193b8722-9c52-47cf-848e-43bb5edd5ebd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:18:27.973042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 06 12:18:27.973042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: Oct 06 12:18:27.975016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b8722-9c52-47cf-848e-43bb5edd5ebd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:27.999125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 748/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:18:27 2022] PUT /identity/v3/projects/5ff9f309897642219e43f3809234fe50/users/ae1eee81e2854f05ae9470df96612731/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:18:28.011206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af3ee-2bfa-4d88-bcd7-729fa2b69a16 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:28.011487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af3ee-2bfa-4d88-bcd7-729fa2b69a16 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:28.011756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af3ee-2bfa-4d88-bcd7-729fa2b69a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:28.069335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4d0af3ee-2bfa-4d88-bcd7-729fa2b69a16 None None] MFA Rules not processed for user `ae1eee81e2854f05ae9470df96612731`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:18:28.070593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4d0af3ee-2bfa-4d88-bcd7-729fa2b69a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:28.150710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 754/1502] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:18:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:18:28.164324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6e4a-4947-4ce4-a309-581a017c1813 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:28.164606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6e4a-4947-4ce4-a309-581a017c1813 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:28.164879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6e4a-4947-4ce4-a309-581a017c1813 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:28.166258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 749/1503] 10.222.0.15 () {54 vars in 963 bytes} [Thu Oct 6 12:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:18:28.171745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6f9f4-2e42-40e8-9e8c-868b7a194b11 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:28.172030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6f9f4-2e42-40e8-9e8c-868b7a194b11 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:28.172312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6f9f4-2e42-40e8-9e8c-868b7a194b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:28.206553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:28.253425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ada6f9f4-2e42-40e8-9e8c-868b7a194b11 None None] MFA Rules not processed for user `f401923fe84446b9962e854f1fc2bed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:18:28.254663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ada6f9f4-2e42-40e8-9e8c-868b7a194b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:28.329614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 755/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Thu Oct 6 12:18:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:18:28.337289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d6e4a-4947-4ce4-a309-581a017c1813 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:28.338867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c80d6e4a-4947-4ce4-a309-581a017c1813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:28.389318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:28.446022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d6e4a-4947-4ce4-a309-581a017c1813 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:28.519980 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:28.520499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:28.520782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:28.521056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:28.522737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:28.622003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:28.623548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:28.627032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:28.642632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 750/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:18:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:18:28.688710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f0dd-9df8-4f2e-9943-807ff349337d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:28.689176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f0dd-9df8-4f2e-9943-807ff349337d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:28.689282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f0dd-9df8-4f2e-9943-807ff349337d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:28.690558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 756/1506] 10.222.0.15 () {52 vars in 830 bytes} [Thu Oct 6 12:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:18:28.694275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:28.695490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:28.792929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62f61-0fe4-45be-938b-f78d570806f8 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:28.887418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:28.888159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:28.888311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:28.889180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] PATH_INFO: `/v3/users/ae1eee81e2854f05ae9470df96612731` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:28.902186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1eee81e2854f05ae9470df96612731)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:28.903205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:18:28.903205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 06 12:18:28.903205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: Oct 06 12:18:28.905286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:28.914881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:28.972121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1eee81e2854f05ae9470df96612731'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:28.972567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1eee81e2854f05ae9470df96612731'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:28.982646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1eee81e2854f05ae9470df96612731'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:29.009641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1eee81e2854f05ae9470df96612731'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:29.026332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1eee81e2854f05ae9470df96612731'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:29.032283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 751/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:18:28 2022] DELETE /identity/v3/users/ae1eee81e2854f05ae9470df96612731 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:18:29.036756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc488-a9ee-4d67-bb77-6f8d2f84638d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:29.037192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc488-a9ee-4d67-bb77-6f8d2f84638d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:29.037642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc488-a9ee-4d67-bb77-6f8d2f84638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:29.095107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0cfbc488-a9ee-4d67-bb77-6f8d2f84638d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:18:29.096206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0cfbc488-a9ee-4d67-bb77-6f8d2f84638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:29.171925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:29.184242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 757/1508] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:18:29.194382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:29.195642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:29.297736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646d017-db4c-4842-82df-61d9a440ebf8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:29.356238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:29.378689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5881338-9967-470e-a121-d182b9f3324e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:29.379296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5881338-9967-470e-a121-d182b9f3324e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:29.379581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5881338-9967-470e-a121-d182b9f3324e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:29.379854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5881338-9967-470e-a121-d182b9f3324e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:29.381460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5881338-9967-470e-a121-d182b9f3324e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:29.493251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5881338-9967-470e-a121-d182b9f3324e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:29.494742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5881338-9967-470e-a121-d182b9f3324e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:29.515350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 752/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:18:29.864996 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbc488-a9ee-4d67-bb77-6f8d2f84638d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:18:29.866348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0cfbc488-a9ee-4d67-bb77-6f8d2f84638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:18:29.879185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbc488-a9ee-4d67-bb77-6f8d2f84638d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:18:29.989769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:18:29.990406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:18:29.990682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:18:29.990949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] PATH_INFO: `/v3/projects/5ff9f309897642219e43f3809234fe50` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:18:30.002023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff9f309897642219e43f3809234fe50)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:18:30.003059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:18:30.003059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: warnings.warn(msg) Oct 06 12:18:30.003059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: Oct 06 12:18:30.004588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:18:30.068963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff9f309897642219e43f3809234fe50', 'request_id': 'req-70480592-ec2b-4f96-a404-d5c0bf354aab'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:30.083267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff9f309897642219e43f3809234fe50', 'request_id': 'req-70480592-ec2b-4f96-a404-d5c0bf354aab'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:30.090031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff9f309897642219e43f3809234fe50', 'request_id': 'req-70480592-ec2b-4f96-a404-d5c0bf354aab'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:30.117589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] The token cache is being invalidate because project 5ff9f309897642219e43f3809234fe50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:18:30.117814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:30.118320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70480592-ec2b-4f96-a404-d5c0bf354aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:18:30.119729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 758/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:18:29 2022] DELETE /identity/v3/projects/5ff9f309897642219e43f3809234fe50 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:18:39.512302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=62 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:18:40.115443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:20:26.937129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789066f-c0dd-4eac-860b-d2dc7586fbde None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:26.937751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789066f-c0dd-4eac-860b-d2dc7586fbde None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:26.937751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789066f-c0dd-4eac-860b-d2dc7586fbde None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:26.939107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:20:26.944049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2eb4-48c1-42ea-99ff-d829be4d850c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:26.944506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2eb4-48c1-42ea-99ff-d829be4d850c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:26.944616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2eb4-48c1-42ea-99ff-d829be4d850c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:27.024412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3a9e2eb4-48c1-42ea-99ff-d829be4d850c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:27.026465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3a9e2eb4-48c1-42ea-99ff-d829be4d850c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:27.132577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:20:27.288700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789066f-c0dd-4eac-860b-d2dc7586fbde None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:27.290827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3789066f-c0dd-4eac-860b-d2dc7586fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:27.407380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789066f-c0dd-4eac-860b-d2dc7586fbde None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:27.412813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75173d-235b-44ec-969b-723db36d557d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:27.413412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75173d-235b-44ec-969b-723db36d557d service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:27.413723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75173d-235b-44ec-969b-723db36d557d service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:27.413997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75173d-235b-44ec-969b-723db36d557d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:27.422047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75173d-235b-44ec-969b-723db36d557d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:27.423603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75173d-235b-44ec-969b-723db36d557d service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:27.433630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 754/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:20:28.542987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07728c-216c-4eac-8d50-592b66a57863 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:28.543581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07728c-216c-4eac-8d50-592b66a57863 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:28.543581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07728c-216c-4eac-8d50-592b66a57863 None None] PATH_INFO: `/v3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:28.544825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 760/1514] 10.222.0.40 () {54 vars in 925 bytes} [Thu Oct 6 12:20:28 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:20:28.551299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d841-f456-4012-bd33-2c73f09146f3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:28.551741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d841-f456-4012-bd33-2c73f09146f3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:28.551886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d841-f456-4012-bd33-2c73f09146f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:28.554057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a084-9138-4be7-bebb-58465b9fab70 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:28.554321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a084-9138-4be7-bebb-58465b9fab70 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:28.554707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a084-9138-4be7-bebb-58465b9fab70 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:28.556128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 761/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:20:28.563722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc9c-8237-41de-b82e-5f9cabe7245b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:28.564007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc9c-8237-41de-b82e-5f9cabe7245b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:28.564289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc9c-8237-41de-b82e-5f9cabe7245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:28.584173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3e1efc9c-8237-41de-b82e-5f9cabe7245b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:28.585395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3e1efc9c-8237-41de-b82e-5f9cabe7245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:28.594393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 762/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:20:28.614487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dde9d841-f456-4012-bd33-2c73f09146f3 None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:28.615691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dde9d841-f456-4012-bd33-2c73f09146f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:28.684057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:20:28.689639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 755/1517] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Oct 6 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:20:28.752788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efc9c-8237-41de-b82e-5f9cabe7245b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:28.765681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efc9c-8237-41de-b82e-5f9cabe7245b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:28.771133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9a76b-ecbe-4f23-a88a-d6db51deaf58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:28.771730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9a76b-ecbe-4f23-a88a-d6db51deaf58 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:28.772016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9a76b-ecbe-4f23-a88a-d6db51deaf58 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:28.772290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9a76b-ecbe-4f23-a88a-d6db51deaf58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:28.781472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9a76b-ecbe-4f23-a88a-d6db51deaf58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:28.783095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9a76b-ecbe-4f23-a88a-d6db51deaf58 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:28.794346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 763/1518] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:20:37.325003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433c24-6cf5-4d26-b0cf-dcc796a60e20 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:37.325457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433c24-6cf5-4d26-b0cf-dcc796a60e20 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:37.325649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433c24-6cf5-4d26-b0cf-dcc796a60e20 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:37.326978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 756/1519] 10.222.0.15 () {54 vars in 961 bytes} [Thu Oct 6 12:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:20:37.332059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb870-0909-4aa0-b181-1738b149ed74 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:37.332481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb870-0909-4aa0-b181-1738b149ed74 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:37.332591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb870-0909-4aa0-b181-1738b149ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:37.352238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-aa3eb870-0909-4aa0-b181-1738b149ed74 None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:37.353432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-aa3eb870-0909-4aa0-b181-1738b149ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:37.361992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 764/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Oct 6 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:20:37.370046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8433c24-6cf5-4d26-b0cf-dcc796a60e20 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:37.383742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8433c24-6cf5-4d26-b0cf-dcc796a60e20 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:37.389514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1ae57-2058-43f8-93e4-abc587f61ae2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:37.390138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1ae57-2058-43f8-93e4-abc587f61ae2 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:37.390426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1ae57-2058-43f8-93e4-abc587f61ae2 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:37.390707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1ae57-2058-43f8-93e4-abc587f61ae2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:37.399013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1ae57-2058-43f8-93e4-abc587f61ae2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:37.400949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1ae57-2058-43f8-93e4-abc587f61ae2 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:37.410629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 757/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:20:40.261382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47fc6-63e7-4fea-85f5-9b128206711d None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:40.261958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47fc6-63e7-4fea-85f5-9b128206711d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:40.261958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47fc6-63e7-4fea-85f5-9b128206711d None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:40.263199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:20:40.269361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d22a-b3c4-4012-8a7b-64b823561c91 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:40.269827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d22a-b3c4-4012-8a7b-64b823561c91 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:40.269941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890d22a-b3c4-4012-8a7b-64b823561c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:40.292672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1890d22a-b3c4-4012-8a7b-64b823561c91 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:40.293937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1890d22a-b3c4-4012-8a7b-64b823561c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:40.302149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:20:40.466790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b47fc6-63e7-4fea-85f5-9b128206711d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:40.481629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b47fc6-63e7-4fea-85f5-9b128206711d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:40.487023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a7aa4-a37a-4d5c-a482-8c0f2e96c098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:40.487611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a7aa4-a37a-4d5c-a482-8c0f2e96c098 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:40.487895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a7aa4-a37a-4d5c-a482-8c0f2e96c098 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:40.488161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a7aa4-a37a-4d5c-a482-8c0f2e96c098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:40.496489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a7aa4-a37a-4d5c-a482-8c0f2e96c098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:40.498115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a7aa4-a37a-4d5c-a482-8c0f2e96c098 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:40.507666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 766/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:20:41.582224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77943b-4bd8-421b-903e-dc2f4fbee1a3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:41.582727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77943b-4bd8-421b-903e-dc2f4fbee1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:41.582727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77943b-4bd8-421b-903e-dc2f4fbee1a3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:41.584064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 6 12:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:20:41.590848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd34d-deac-48d4-97ff-db2e805b6d9e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:41.591269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd34d-deac-48d4-97ff-db2e805b6d9e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:41.591378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd34d-deac-48d4-97ff-db2e805b6d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:41.610262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-eb7bd34d-deac-48d4-97ff-db2e805b6d9e None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:41.611441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eb7bd34d-deac-48d4-97ff-db2e805b6d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:41.619185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 6 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:20:41.770757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77943b-4bd8-421b-903e-dc2f4fbee1a3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:41.785179 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77943b-4bd8-421b-903e-dc2f4fbee1a3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:41.790565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c22b40-ad0c-4979-8326-bb3c568e751a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:41.791265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c22b40-ad0c-4979-8326-bb3c568e751a service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:41.791774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c22b40-ad0c-4979-8326-bb3c568e751a service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:41.792118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c22b40-ad0c-4979-8326-bb3c568e751a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:41.800131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c22b40-ad0c-4979-8326-bb3c568e751a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:41.801746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c22b40-ad0c-4979-8326-bb3c568e751a service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:41.811449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 760/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:20:45.877941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dc3b6-7bec-4a80-857b-6da179bbc193 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:45.878484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dc3b6-7bec-4a80-857b-6da179bbc193 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:45.878484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dc3b6-7bec-4a80-857b-6da179bbc193 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:45.879856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:20:45.885817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664da5a1-cc58-4257-ad85-b8118080d301 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:45.886278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664da5a1-cc58-4257-ad85-b8118080d301 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:45.886376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664da5a1-cc58-4257-ad85-b8118080d301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:45.905638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-664da5a1-cc58-4257-ad85-b8118080d301 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:45.906830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-664da5a1-cc58-4257-ad85-b8118080d301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:45.914604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:20:46.280472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dc3b6-7bec-4a80-857b-6da179bbc193 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:46.282264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f67dc3b6-7bec-4a80-857b-6da179bbc193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:46.308132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:20:46.366325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dc3b6-7bec-4a80-857b-6da179bbc193 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:46.371278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4709fcd-e73a-4db0-b545-ffc1e56cbccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:46.372144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709fcd-e73a-4db0-b545-ffc1e56cbccc service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:46.372144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709fcd-e73a-4db0-b545-ffc1e56cbccc service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:46.373015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709fcd-e73a-4db0-b545-ffc1e56cbccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:46.382604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4709fcd-e73a-4db0-b545-ffc1e56cbccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:46.384010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4709fcd-e73a-4db0-b545-ffc1e56cbccc service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:46.395131 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 769/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:20:48.591718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014602-0169-4c7b-935f-8faff2ae79e1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:48.592315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014602-0169-4c7b-935f-8faff2ae79e1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:48.592315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014602-0169-4c7b-935f-8faff2ae79e1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:48.593607 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:20:48.598863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4943ce-2813-4478-98fc-3968b591b4a1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:48.599311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4943ce-2813-4478-98fc-3968b591b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:48.599424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4943ce-2813-4478-98fc-3968b591b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:48.619987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ae4943ce-2813-4478-98fc-3968b591b4a1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:48.621956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ae4943ce-2813-4478-98fc-3968b591b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:48.629939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:20:48.919277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014602-0169-4c7b-935f-8faff2ae79e1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:48.920979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef014602-0169-4c7b-935f-8faff2ae79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:48.935237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014602-0169-4c7b-935f-8faff2ae79e1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:48.938872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e2b2a-c100-498f-bfd4-64ea893c6931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:48.939472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2b2a-c100-498f-bfd4-64ea893c6931 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:48.939752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2b2a-c100-498f-bfd4-64ea893c6931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:48.940017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2b2a-c100-498f-bfd4-64ea893c6931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:48.951143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e2b2a-c100-498f-bfd4-64ea893c6931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:48.952958 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e2b2a-c100-498f-bfd4-64ea893c6931 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:48.964027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 763/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:20:52.806074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c201506-aa76-49ee-94a5-6b37d7fd66df None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:52.806671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c201506-aa76-49ee-94a5-6b37d7fd66df None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:52.806671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c201506-aa76-49ee-94a5-6b37d7fd66df None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:52.807988 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:20:52.817419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae1f5f-d77d-4e3d-abce-6e2c3c45566b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:52.817841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae1f5f-d77d-4e3d-abce-6e2c3c45566b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:52.818009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae1f5f-d77d-4e3d-abce-6e2c3c45566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:52.837513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c8ae1f5f-d77d-4e3d-abce-6e2c3c45566b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:52.839465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c8ae1f5f-d77d-4e3d-abce-6e2c3c45566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:52.847126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:20:53.152978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c201506-aa76-49ee-94a5-6b37d7fd66df None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:53.154689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7c201506-aa76-49ee-94a5-6b37d7fd66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:53.234115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c201506-aa76-49ee-94a5-6b37d7fd66df None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:53.237692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f278d-1e00-4a61-894a-7d3057097aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:53.238291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f278d-1e00-4a61-894a-7d3057097aef service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:53.238574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f278d-1e00-4a61-894a-7d3057097aef service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:53.238847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f278d-1e00-4a61-894a-7d3057097aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:53.247707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f278d-1e00-4a61-894a-7d3057097aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:53.249116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f278d-1e00-4a61-894a-7d3057097aef service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:53.258457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 772/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:20:55.413479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a20c8-ec6e-4406-82b5-5c880e41c47b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:55.414061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a20c8-ec6e-4406-82b5-5c880e41c47b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:55.414061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a20c8-ec6e-4406-82b5-5c880e41c47b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:55.415390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 6 12:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:20:55.420671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3b6e6-ca28-49e5-ad31-d366d36dfc00 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:55.421089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3b6e6-ca28-49e5-ad31-d366d36dfc00 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:55.421217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3b6e6-ca28-49e5-ad31-d366d36dfc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:55.441391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5ac3b6e6-ca28-49e5-ad31-d366d36dfc00 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:20:55.442605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5ac3b6e6-ca28-49e5-ad31-d366d36dfc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:55.451284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 6 12:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:20:55.757520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a20c8-ec6e-4406-82b5-5c880e41c47b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:20:55.759209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4e1a20c8-ec6e-4406-82b5-5c880e41c47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:20:55.772233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a20c8-ec6e-4406-82b5-5c880e41c47b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:20:55.776138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce610aa-dd18-48fd-9ddb-1b215c0a2b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:20:55.776724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce610aa-dd18-48fd-9ddb-1b215c0a2b8e service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:20:55.777007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce610aa-dd18-48fd-9ddb-1b215c0a2b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:20:55.777278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce610aa-dd18-48fd-9ddb-1b215c0a2b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:20:55.786016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce610aa-dd18-48fd-9ddb-1b215c0a2b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:20:55.787441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce610aa-dd18-48fd-9ddb-1b215c0a2b8e service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:20:55.797675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 766/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:21:05.436610 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=66 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:21:05.793667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=34 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:34.621521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a909b5-529f-49cf-8e96-587e3f5adc53 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.622174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a909b5-529f-49cf-8e96-587e3f5adc53 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.622174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a909b5-529f-49cf-8e96-587e3f5adc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.635745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d591-7f35-46c5-87d0-b04ca9ad7b41 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.636953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d591-7f35-46c5-87d0-b04ca9ad7b41 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.637485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d591-7f35-46c5-87d0-b04ca9ad7b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.656437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-49a909b5-529f-49cf-8e96-587e3f5adc53 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:34.658415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-49a909b5-529f-49cf-8e96-587e3f5adc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:34.671443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5029d591-7f35-46c5-87d0-b04ca9ad7b41 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:34.673067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5029d591-7f35-46c5-87d0-b04ca9ad7b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:34.676617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 774/1540] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:22:34.687548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 767/1541] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:34.695292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21e95-58f6-4d79-8b22-4961882477e0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.695598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21e95-58f6-4d79-8b22-4961882477e0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.695865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21e95-58f6-4d79-8b22-4961882477e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.697040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97dcf5-5b72-46b3-830b-85c9913e631c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.697747 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97dcf5-5b72-46b3-830b-85c9913e631c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.698239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97dcf5-5b72-46b3-830b-85c9913e631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.728058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c8f21e95-58f6-4d79-8b22-4961882477e0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:34.729319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c8f21e95-58f6-4d79-8b22-4961882477e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:34.734989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6e97dcf5-5b72-46b3-830b-85c9913e631c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:34.736622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e97dcf5-5b72-46b3-830b-85c9913e631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:34.745736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 775/1542] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:34.747213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5914c-6339-4266-94c4-947906e74484 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.747424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5914c-6339-4266-94c4-947906e74484 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.747705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5914c-6339-4266-94c4-947906e74484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.754368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 768/1543] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:34.755540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97dcf5-5b72-46b3-830b-85c9913e631c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:34.773857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97dcf5-5b72-46b3-830b-85c9913e631c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:34.780596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6ca5914c-6339-4266-94c4-947906e74484 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:34.780778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd95db7-7fbe-46cd-8c43-4a161874e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:34.781663 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95db7-7fbe-46cd-8c43-4a161874e4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.781860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6ca5914c-6339-4266-94c4-947906e74484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:34.782364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95db7-7fbe-46cd-8c43-4a161874e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.782855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95db7-7fbe-46cd-8c43-4a161874e4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.783715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd95db7-7fbe-46cd-8c43-4a161874e4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:34.784231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd95db7-7fbe-46cd-8c43-4a161874e4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:34.785768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-1fd95db7-7fbe-46cd-8c43-4a161874e4d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:22:34.785768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 06 12:22:34.785768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: Oct 06 12:22:34.787589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd95db7-7fbe-46cd-8c43-4a161874e4d6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:34.808045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 776/1544] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:34.808983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5914c-6339-4266-94c4-947906e74484 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:34.812111 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 769/1545] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:34.816551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9c8c-62de-4b0d-bc68-46d02327ec7c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.817106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9c8c-62de-4b0d-bc68-46d02327ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.817627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9c8c-62de-4b0d-bc68-46d02327ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.824718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5914c-6339-4266-94c4-947906e74484 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:34.851149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:34.851782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.852080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.852397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.857558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:34.857558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:34.857558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:34.859116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b11b9c8c-62de-4b0d-bc68-46d02327ec7c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:34.860603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b11b9c8c-62de-4b0d-bc68-46d02327ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:34.876153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 770/1546] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:34.877381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b9c8c-62de-4b0d-bc68-46d02327ec7c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:34.885132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 777/1547] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:34.885132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:34.892962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b9c8c-62de-4b0d-bc68-46d02327ec7c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:34.900237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb76731-5119-4d42-bf6e-91dabe937cb1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:34.904548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b5b58-1776-4163-9afb-e539cf84f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:34.905433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5b58-1776-4163-9afb-e539cf84f588 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.906002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5b58-1776-4163-9afb-e539cf84f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.906518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5b58-1776-4163-9afb-e539cf84f588 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.907477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b5b58-1776-4163-9afb-e539cf84f588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:34.910143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b5b58-1776-4163-9afb-e539cf84f588 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:34.918839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:34.919467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.919755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.920036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.922285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:34.922428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:34.924016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:34.941794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 778/1548] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:34.949394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:34.963277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d072717-5316-40c7-92b1-2ab7086efdf7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:34.970805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9c97e-163c-4e7a-927a-02bc981bf25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:34.971923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c97e-163c-4e7a-927a-02bc981bf25e admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.972485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c97e-163c-4e7a-927a-02bc981bf25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.973006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c97e-163c-4e7a-927a-02bc981bf25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.973419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 771/1549] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:34.974365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9c97e-163c-4e7a-927a-02bc981bf25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:34.974760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f7d2-28aa-4d43-8991-bd652c9cec61 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:34.975060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f7d2-28aa-4d43-8991-bd652c9cec61 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:34.975340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f7d2-28aa-4d43-8991-bd652c9cec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:34.976452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-32b9c97e-163c-4e7a-927a-02bc981bf25e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:22:34.976452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: warnings.warn(msg) Oct 06 12:22:34.976452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: Oct 06 12:22:34.978294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9c97e-163c-4e7a-927a-02bc981bf25e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.004672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7ad7f7d2-28aa-4d43-8991-bd652c9cec61 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.006311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7ad7f7d2-28aa-4d43-8991-bd652c9cec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.013580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 779/1550] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.014987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbcfba-5608-441f-a360-6b02a01c2c33 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.015276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbcfba-5608-441f-a360-6b02a01c2c33 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.015556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbcfba-5608-441f-a360-6b02a01c2c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.035832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b9dbcfba-5608-441f-a360-6b02a01c2c33 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.037752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b9dbcfba-5608-441f-a360-6b02a01c2c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.069620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 772/1551] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.070554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f7d2-28aa-4d43-8991-bd652c9cec61 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.086528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f7d2-28aa-4d43-8991-bd652c9cec61 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.102233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 780/1552] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.103484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351791-1ae8-456b-ba06-25763f983f3c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.103820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351791-1ae8-456b-ba06-25763f983f3c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.104094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351791-1ae8-456b-ba06-25763f983f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.125513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2f351791-1ae8-456b-ba06-25763f983f3c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.126978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2f351791-1ae8-456b-ba06-25763f983f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.136276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 781/1553] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.138314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f351791-1ae8-456b-ba06-25763f983f3c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.149427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f351791-1ae8-456b-ba06-25763f983f3c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.151013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53c2aa-035d-4812-baf8-9f68cbb26688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.151635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c2aa-035d-4812-baf8-9f68cbb26688 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.151920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c2aa-035d-4812-baf8-9f68cbb26688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.152195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c2aa-035d-4812-baf8-9f68cbb26688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.152888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53c2aa-035d-4812-baf8-9f68cbb26688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.154706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6281f-7e03-45a1-bb4f-3d137f8999c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.155104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53c2aa-035d-4812-baf8-9f68cbb26688 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.155324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6281f-7e03-45a1-bb4f-3d137f8999c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.155628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6281f-7e03-45a1-bb4f-3d137f8999c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.155896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6281f-7e03-45a1-bb4f-3d137f8999c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.156518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6281f-7e03-45a1-bb4f-3d137f8999c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.158522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6281f-7e03-45a1-bb4f-3d137f8999c3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.184419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 782/1554] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.184419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567de45-6126-4359-a080-fcefd7bdcbc4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.184419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567de45-6126-4359-a080-fcefd7bdcbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.184419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567de45-6126-4359-a080-fcefd7bdcbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.184905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 773/1555] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.185454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa3b1-5113-4fbb-a811-e24a98e08bf9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.185820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa3b1-5113-4fbb-a811-e24a98e08bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.186103 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa3b1-5113-4fbb-a811-e24a98e08bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.203871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9567de45-6126-4359-a080-fcefd7bdcbc4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.205089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9567de45-6126-4359-a080-fcefd7bdcbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.205206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a2daa3b1-5113-4fbb-a811-e24a98e08bf9 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.206327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a2daa3b1-5113-4fbb-a811-e24a98e08bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.224242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:35.267211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 774/1556] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.267607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 783/1557] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.268723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbff05-0a47-4048-8ad0-8f6fb85ff913 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.268846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daa3b1-5113-4fbb-a811-e24a98e08bf9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.269025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbff05-0a47-4048-8ad0-8f6fb85ff913 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.269278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbff05-0a47-4048-8ad0-8f6fb85ff913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.281369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daa3b1-5113-4fbb-a811-e24a98e08bf9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.286391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f6827-6480-4c75-9d9e-b0fba5d5ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.287217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6827-6480-4c75-9d9e-b0fba5d5ea27 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.287475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6827-6480-4c75-9d9e-b0fba5d5ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.287851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6827-6480-4c75-9d9e-b0fba5d5ea27 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.288487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f6827-6480-4c75-9d9e-b0fba5d5ea27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.289494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-506f6827-6480-4c75-9d9e-b0fba5d5ea27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:22:35.289494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 06 12:22:35.289494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: Oct 06 12:22:35.290850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f6827-6480-4c75-9d9e-b0fba5d5ea27 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.293800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b0cbff05-0a47-4048-8ad0-8f6fb85ff913 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.295001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b0cbff05-0a47-4048-8ad0-8f6fb85ff913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.306310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 784/1558] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.306310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8658b01-3e3f-416c-b98b-24fc8e36b1ed None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.306310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8658b01-3e3f-416c-b98b-24fc8e36b1ed None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.306310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8658b01-3e3f-416c-b98b-24fc8e36b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.313692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 775/1559] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.314165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:35.315035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b7a4d-2f3b-494d-a7a8-669c9bc63bc2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.315326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b7a4d-2f3b-494d-a7a8-669c9bc63bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.315600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b7a4d-2f3b-494d-a7a8-669c9bc63bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.331332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d8658b01-3e3f-416c-b98b-24fc8e36b1ed None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.332537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d8658b01-3e3f-416c-b98b-24fc8e36b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.337173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a44b7a4d-2f3b-494d-a7a8-669c9bc63bc2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.338419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a44b7a4d-2f3b-494d-a7a8-669c9bc63bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.341442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 785/1560] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.342261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8658b01-3e3f-416c-b98b-24fc8e36b1ed None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.350399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 776/1561] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.351298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b7a4d-2f3b-494d-a7a8-669c9bc63bc2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.352042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8658b01-3e3f-416c-b98b-24fc8e36b1ed None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.356866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322233c-7488-4b97-b85d-07700d5428e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.357476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322233c-7488-4b97-b85d-07700d5428e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.357790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322233c-7488-4b97-b85d-07700d5428e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.358089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322233c-7488-4b97-b85d-07700d5428e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.358736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322233c-7488-4b97-b85d-07700d5428e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.360337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322233c-7488-4b97-b85d-07700d5428e9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.362174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b7a4d-2f3b-494d-a7a8-669c9bc63bc2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.367411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb9c0a-4694-4bb2-b42d-6f6ee6b051ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.368007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9c0a-4694-4bb2-b42d-6f6ee6b051ff admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.368287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9c0a-4694-4bb2-b42d-6f6ee6b051ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.368556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb9c0a-4694-4bb2-b42d-6f6ee6b051ff admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.369189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb9c0a-4694-4bb2-b42d-6f6ee6b051ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.370727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 786/1562] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:35.371122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb9c0a-4694-4bb2-b42d-6f6ee6b051ff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.371937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8fcb-69c0-4bdc-bced-5a6300a0738d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.372219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8fcb-69c0-4bdc-bced-5a6300a0738d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.372490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8fcb-69c0-4bdc-bced-5a6300a0738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.392064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-af7c8fcb-69c0-4bdc-bced-5a6300a0738d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.393184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-af7c8fcb-69c0-4bdc-bced-5a6300a0738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.397283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 777/1563] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.397283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b067d2-eb09-41b2-ba7e-0c2285a8c178 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.397283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b067d2-eb09-41b2-ba7e-0c2285a8c178 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.397283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b067d2-eb09-41b2-ba7e-0c2285a8c178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.401408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 787/1564] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.402239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8fcb-69c0-4bdc-bced-5a6300a0738d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.412897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8fcb-69c0-4bdc-bced-5a6300a0738d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.415886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-38b067d2-eb09-41b2-ba7e-0c2285a8c178 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:35.417086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-38b067d2-eb09-41b2-ba7e-0c2285a8c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:35.418941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.419870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.420323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.420793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.421824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:35.422271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.424522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.425336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 778/1565] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:35.426142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b067d2-eb09-41b2-ba7e-0c2285a8c178 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.436106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b067d2-eb09-41b2-ba7e-0c2285a8c178 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.439735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 788/1566] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:35.440775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.442945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf50dd-d380-4704-a2ce-86e15fac2cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.444018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf50dd-d380-4704-a2ce-86e15fac2cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.444411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf50dd-d380-4704-a2ce-86e15fac2cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.444790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf50dd-d380-4704-a2ce-86e15fac2cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.445600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf50dd-d380-4704-a2ce-86e15fac2cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.447348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf50dd-d380-4704-a2ce-86e15fac2cb6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.452322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3543e45-e6d7-494b-a16a-e2a189e31646 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.457266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.461396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 779/1567] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:35.461589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.461589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.461784 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf50dd-d380-4704-a2ce-86e15fac2cb6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.461875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.461875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:35.461875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.461875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.471032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf50dd-d380-4704-a2ce-86e15fac2cb6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.473587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 789/1568] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:35.474187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.480473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.481383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.481525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.481737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.482453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:35.482772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.484341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.487741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ada922-35ff-471d-af8a-9f4de1c8f19d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.492648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9647e38-3818-4a4f-be09-3f1fa047b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.493248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9647e38-3818-4a4f-be09-3f1fa047b50f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.493525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9647e38-3818-4a4f-be09-3f1fa047b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.493824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9647e38-3818-4a4f-be09-3f1fa047b50f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.494465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9647e38-3818-4a4f-be09-3f1fa047b50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.496043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9647e38-3818-4a4f-be09-3f1fa047b50f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.496637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 780/1569] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:35.497447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.507462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cec650-25b2-475d-9c70-8939e98bc1a5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.512072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44dec3-c110-424c-9f3a-5c0eebc765bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.512667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44dec3-c110-424c-9f3a-5c0eebc765bb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.512810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 790/1570] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:35.512949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44dec3-c110-424c-9f3a-5c0eebc765bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.513220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44dec3-c110-424c-9f3a-5c0eebc765bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.513957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44dec3-c110-424c-9f3a-5c0eebc765bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.514551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9647e38-3818-4a4f-be09-3f1fa047b50f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.515541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44dec3-c110-424c-9f3a-5c0eebc765bb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.525073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9647e38-3818-4a4f-be09-3f1fa047b50f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.526612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 781/1571] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:35.527413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44dec3-c110-424c-9f3a-5c0eebc765bb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.532769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.533364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.533754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.534026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.534689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:35.534985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.536606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.537370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44dec3-c110-424c-9f3a-5c0eebc765bb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.541948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.542561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.542844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.543117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.543766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:35.544058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.545671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.549515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 791/1572] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:35.550137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.559691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5eeb9-7ee2-47d9-9bb6-c30a5d049dee admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.566736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 782/1573] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:35.566736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.570507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd890f-2699-403c-96e5-407a7e6a7a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.571114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd890f-2699-403c-96e5-407a7e6a7a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.571390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd890f-2699-403c-96e5-407a7e6a7a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.571660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd890f-2699-403c-96e5-407a7e6a7a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.572297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd890f-2699-403c-96e5-407a7e6a7a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.573667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8050a8-bd7e-427d-84e3-fef088dd07cc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.574324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd890f-2699-403c-96e5-407a7e6a7a77 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.578327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7b3d9-7e6e-4096-8d4c-9f696a08fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.578921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7b3d9-7e6e-4096-8d4c-9f696a08fd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.579202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7b3d9-7e6e-4096-8d4c-9f696a08fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.579475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7b3d9-7e6e-4096-8d4c-9f696a08fd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.580125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7b3d9-7e6e-4096-8d4c-9f696a08fd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.581737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7b3d9-7e6e-4096-8d4c-9f696a08fd6b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.592077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 783/1574] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:35.592836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7b3d9-7e6e-4096-8d4c-9f696a08fd6b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.601935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 792/1575] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.602581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd890f-2699-403c-96e5-407a7e6a7a77 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.603089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7b3d9-7e6e-4096-8d4c-9f696a08fd6b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.660729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a7916-bb6c-4a5f-841e-34bae7d45c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.661425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a7916-bb6c-4a5f-841e-34bae7d45c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.661733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a7916-bb6c-4a5f-841e-34bae7d45c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.662072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a7916-bb6c-4a5f-841e-34bae7d45c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.662799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a7916-bb6c-4a5f-841e-34bae7d45c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.664701 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a7916-bb6c-4a5f-841e-34bae7d45c70 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.665551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd890f-2699-403c-96e5-407a7e6a7a77 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.670587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399135a8-050d-460e-b8d1-2a560f6f345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.671193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399135a8-050d-460e-b8d1-2a560f6f345b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.671471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399135a8-050d-460e-b8d1-2a560f6f345b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.671774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399135a8-050d-460e-b8d1-2a560f6f345b admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.672405 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399135a8-050d-460e-b8d1-2a560f6f345b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.674345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399135a8-050d-460e-b8d1-2a560f6f345b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.687234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:35.695523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 784/1576] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.696306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a7916-bb6c-4a5f-841e-34bae7d45c70 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.710155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 793/1577] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.710494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399135a8-050d-460e-b8d1-2a560f6f345b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.762946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a7916-bb6c-4a5f-841e-34bae7d45c70 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.763854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:35.776779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399135a8-050d-460e-b8d1-2a560f6f345b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.781610 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824c18e-d7a6-46e3-8203-e74ed7cccc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.782221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824c18e-d7a6-46e3-8203-e74ed7cccc4b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.782499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824c18e-d7a6-46e3-8203-e74ed7cccc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.782771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824c18e-d7a6-46e3-8203-e74ed7cccc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.783439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824c18e-d7a6-46e3-8203-e74ed7cccc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.785030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824c18e-d7a6-46e3-8203-e74ed7cccc4b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.794874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 794/1578] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:35.795733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824c18e-d7a6-46e3-8203-e74ed7cccc4b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.805693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824c18e-d7a6-46e3-8203-e74ed7cccc4b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.810682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45b078-932b-43f9-8503-07a0d0db865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.811655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45b078-932b-43f9-8503-07a0d0db865f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.811943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45b078-932b-43f9-8503-07a0d0db865f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.812217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45b078-932b-43f9-8503-07a0d0db865f admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.812874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45b078-932b-43f9-8503-07a0d0db865f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.814859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45b078-932b-43f9-8503-07a0d0db865f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.822862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d727493-6e1d-4010-84e3-c9d9f9cd70a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.823528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d727493-6e1d-4010-84e3-c9d9f9cd70a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.823828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d727493-6e1d-4010-84e3-c9d9f9cd70a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.824098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d727493-6e1d-4010-84e3-c9d9f9cd70a6 admin admin] PATH_INFO: `/v3/projects/66a73e05a37441be908240f7aaae01ad/users/db1b6c3b58304f179b77be28f0be2808/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.840495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d727493-6e1d-4010-84e3-c9d9f9cd70a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a73e05a37441be908240f7aaae01ad, user_id=db1b6c3b58304f179b77be28f0be2808, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.842591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 795/1579] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.843245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d727493-6e1d-4010-84e3-c9d9f9cd70a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.843386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45b078-932b-43f9-8503-07a0d0db865f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.858481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 785/1580] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:35 2022] PUT /identity/v3/projects/66a73e05a37441be908240f7aaae01ad/users/db1b6c3b58304f179b77be28f0be2808/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:35.859209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d727493-6e1d-4010-84e3-c9d9f9cd70a6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.913643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45b078-932b-43f9-8503-07a0d0db865f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.918484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be33a-33a0-493d-bdac-1caa450e20e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.919092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be33a-33a0-493d-bdac-1caa450e20e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.919375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be33a-33a0-493d-bdac-1caa450e20e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.919650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be33a-33a0-493d-bdac-1caa450e20e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.920312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be33a-33a0-493d-bdac-1caa450e20e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.922269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be33a-33a0-493d-bdac-1caa450e20e0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.922588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d727493-6e1d-4010-84e3-c9d9f9cd70a6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:35.927250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37b8a4-bedf-4fc4-abc2-a4992eae90a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:35.928013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b8a4-bedf-4fc4-abc2-a4992eae90a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:35.928293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b8a4-bedf-4fc4-abc2-a4992eae90a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:35.928572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b8a4-bedf-4fc4-abc2-a4992eae90a0 admin admin] PATH_INFO: `/v3/projects/838a60cbb3fb40c7877dde30d3339ee8/users/32511aa67a264334b960faa7e5d72bba/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:35.944274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37b8a4-bedf-4fc4-abc2-a4992eae90a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838a60cbb3fb40c7877dde30d3339ee8, user_id=32511aa67a264334b960faa7e5d72bba, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:35.947002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37b8a4-bedf-4fc4-abc2-a4992eae90a0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:35.950326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 796/1581] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:35.951078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be33a-33a0-493d-bdac-1caa450e20e0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.964911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 786/1582] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:35 2022] PUT /identity/v3/projects/838a60cbb3fb40c7877dde30d3339ee8/users/32511aa67a264334b960faa7e5d72bba/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:35.966101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37b8a4-bedf-4fc4-abc2-a4992eae90a0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:35.984271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:36.016916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be33a-33a0-493d-bdac-1caa450e20e0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.033941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37b8a4-bedf-4fc4-abc2-a4992eae90a0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.039686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19315d7-8a3f-4f75-af12-a689483424f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.040301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19315d7-8a3f-4f75-af12-a689483424f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.040590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19315d7-8a3f-4f75-af12-a689483424f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.040870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19315d7-8a3f-4f75-af12-a689483424f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.041614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19315d7-8a3f-4f75-af12-a689483424f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.043590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19315d7-8a3f-4f75-af12-a689483424f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.066636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 787/1583] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:36.069000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19315d7-8a3f-4f75-af12-a689483424f0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.071960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:36.079280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb24de4-e999-4cc3-bb59-37dcb09a754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.079456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19315d7-8a3f-4f75-af12-a689483424f0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.080097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24de4-e999-4cc3-bb59-37dcb09a754f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.080438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24de4-e999-4cc3-bb59-37dcb09a754f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.080651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24de4-e999-4cc3-bb59-37dcb09a754f admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.081287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb24de4-e999-4cc3-bb59-37dcb09a754f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.083283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb24de4-e999-4cc3-bb59-37dcb09a754f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.084140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3cb5-04a5-480d-81ca-bb7d24a280d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.084738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3cb5-04a5-480d-81ca-bb7d24a280d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.085047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3cb5-04a5-480d-81ca-bb7d24a280d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.085320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3cb5-04a5-480d-81ca-bb7d24a280d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.085993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3cb5-04a5-480d-81ca-bb7d24a280d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.087929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3cb5-04a5-480d-81ca-bb7d24a280d3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.107441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 797/1584] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:35 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:36.108654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb24de4-e999-4cc3-bb59-37dcb09a754f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.110216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 788/1585] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:36.110973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3cb5-04a5-480d-81ca-bb7d24a280d3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.119114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb24de4-e999-4cc3-bb59-37dcb09a754f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.120652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3cb5-04a5-480d-81ca-bb7d24a280d3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.123902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.124581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.124861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.125146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] PATH_INFO: `/v3/projects/e90cbcbf38dd4492888f59e552ae1f16/users/8f1e7d78567844e4a1fa2d969a4f4821/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.125351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740ff6f-2b6d-49a1-b47e-99f8a5796a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.125966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ff6f-2b6d-49a1-b47e-99f8a5796a83 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.126251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ff6f-2b6d-49a1-b47e-99f8a5796a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.126525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ff6f-2b6d-49a1-b47e-99f8a5796a83 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.127157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740ff6f-2b6d-49a1-b47e-99f8a5796a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.130231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740ff6f-2b6d-49a1-b47e-99f8a5796a83 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.140635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90cbcbf38dd4492888f59e552ae1f16, user_id=8f1e7d78567844e4a1fa2d969a4f4821, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.141693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:22:36.141693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: warnings.warn(msg) Oct 06 12:22:36.141693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: Oct 06 12:22:36.143630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.155811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 789/1586] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/users => generated 284 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:36.156390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 798/1587] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:36 2022] PUT /identity/v3/projects/e90cbcbf38dd4492888f59e552ae1f16/users/8f1e7d78567844e4a1fa2d969a4f4821/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:36.157366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.160642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f843-9da9-4ff9-bd1e-126bf938434b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.160959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f843-9da9-4ff9-bd1e-126bf938434b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.161205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f843-9da9-4ff9-bd1e-126bf938434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.180542 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c321f843-9da9-4ff9-bd1e-126bf938434b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:36.181708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c321f843-9da9-4ff9-bd1e-126bf938434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:36.222422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a3fa0-272d-41c6-98f7-9296129b6927 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.227750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7484b2-6cf2-4dd5-bc48-6e31bcd1f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.228356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7484b2-6cf2-4dd5-bc48-6e31bcd1f15e admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.228635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7484b2-6cf2-4dd5-bc48-6e31bcd1f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.228900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7484b2-6cf2-4dd5-bc48-6e31bcd1f15e admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.229530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7484b2-6cf2-4dd5-bc48-6e31bcd1f15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.231517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7484b2-6cf2-4dd5-bc48-6e31bcd1f15e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.240043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 790/1588] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:36.243856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28721bd-38d2-4421-80cb-da34c74c9425 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.243856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28721bd-38d2-4421-80cb-da34c74c9425 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.243856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28721bd-38d2-4421-80cb-da34c74c9425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.258645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 799/1589] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:36.259536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7484b2-6cf2-4dd5-bc48-6e31bcd1f15e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.271819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b28721bd-38d2-4421-80cb-da34c74c9425 None None] MFA Rules not processed for user `32511aa67a264334b960faa7e5d72bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:36.272390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7484b2-6cf2-4dd5-bc48-6e31bcd1f15e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.273585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b28721bd-38d2-4421-80cb-da34c74c9425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:36.277765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564d69a-27d7-4704-b9e6-3f2ac6a18b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.278483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564d69a-27d7-4704-b9e6-3f2ac6a18b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.279132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564d69a-27d7-4704-b9e6-3f2ac6a18b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.279498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564d69a-27d7-4704-b9e6-3f2ac6a18b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.280282 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564d69a-27d7-4704-b9e6-3f2ac6a18b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.282064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564d69a-27d7-4704-b9e6-3f2ac6a18b7e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.295679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 800/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.295679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564d69a-27d7-4704-b9e6-3f2ac6a18b7e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.303540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564d69a-27d7-4704-b9e6-3f2ac6a18b7e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.308411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131103-ebd3-4b4d-8820-c2e2f46836d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.309004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131103-ebd3-4b4d-8820-c2e2f46836d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.309278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131103-ebd3-4b4d-8820-c2e2f46836d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.309575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131103-ebd3-4b4d-8820-c2e2f46836d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.310223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131103-ebd3-4b4d-8820-c2e2f46836d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.311793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131103-ebd3-4b4d-8820-c2e2f46836d6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.323377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 801/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.324612 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131103-ebd3-4b4d-8820-c2e2f46836d6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.335327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131103-ebd3-4b4d-8820-c2e2f46836d6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.339751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:36.339896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7554622-ae61-4ebe-95e3-cc9a647b9993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.340421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7554622-ae61-4ebe-95e3-cc9a647b9993 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.340699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7554622-ae61-4ebe-95e3-cc9a647b9993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.341009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7554622-ae61-4ebe-95e3-cc9a647b9993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.341664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7554622-ae61-4ebe-95e3-cc9a647b9993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.343244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7554622-ae61-4ebe-95e3-cc9a647b9993 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.350258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 791/1592] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:36.350258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28721bd-38d2-4421-80cb-da34c74c9425 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.355778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 802/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.357062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d19f8-4e62-4753-9c79-4bba3dfd0f4b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.357345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d19f8-4e62-4753-9c79-4bba3dfd0f4b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.357645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d19f8-4e62-4753-9c79-4bba3dfd0f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.359290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28721bd-38d2-4421-80cb-da34c74c9425 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.363966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747196d-4e44-4b1a-9757-875cdeb07f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.365415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747196d-4e44-4b1a-9757-875cdeb07f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.366728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747196d-4e44-4b1a-9757-875cdeb07f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.367021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747196d-4e44-4b1a-9757-875cdeb07f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.367686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747196d-4e44-4b1a-9757-875cdeb07f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.369390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747196d-4e44-4b1a-9757-875cdeb07f40 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.376438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3e0d19f8-4e62-4753-9c79-4bba3dfd0f4b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:36.377674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3e0d19f8-4e62-4753-9c79-4bba3dfd0f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:36.380077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 792/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.382448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747196d-4e44-4b1a-9757-875cdeb07f40 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.386496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 803/1595] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:36.387248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d19f8-4e62-4753-9c79-4bba3dfd0f4b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.397097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d19f8-4e62-4753-9c79-4bba3dfd0f4b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.401663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1494-cf84-4b1a-aae8-519cf7010812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.402298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1494-cf84-4b1a-aae8-519cf7010812 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.402579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1494-cf84-4b1a-aae8-519cf7010812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.402862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1494-cf84-4b1a-aae8-519cf7010812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.403508 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1494-cf84-4b1a-aae8-519cf7010812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.405397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1494-cf84-4b1a-aae8-519cf7010812 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.418452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 804/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.418452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1494-cf84-4b1a-aae8-519cf7010812 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.425795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1494-cf84-4b1a-aae8-519cf7010812 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.431134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27652e-4581-45cd-8899-513f05e387f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.431664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27652e-4581-45cd-8899-513f05e387f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.431946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27652e-4581-45cd-8899-513f05e387f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.432219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27652e-4581-45cd-8899-513f05e387f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.432857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27652e-4581-45cd-8899-513f05e387f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.434482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27652e-4581-45cd-8899-513f05e387f5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.444905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 805/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.445590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747196d-4e44-4b1a-9757-875cdeb07f40 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.445945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27652e-4581-45cd-8899-513f05e387f5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.450804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17a53-2dc0-49cf-bb39-3a8b641e1af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.451425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17a53-2dc0-49cf-bb39-3a8b641e1af7 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.451735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17a53-2dc0-49cf-bb39-3a8b641e1af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.452016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17a53-2dc0-49cf-bb39-3a8b641e1af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.455652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27652e-4581-45cd-8899-513f05e387f5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.461107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f4bf0-88e2-48eb-8626-b688d756e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.461724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4bf0-88e2-48eb-8626-b688d756e5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.461951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe17a53-2dc0-49cf-bb39-3a8b641e1af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.462058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4bf0-88e2-48eb-8626-b688d756e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.462262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4bf0-88e2-48eb-8626-b688d756e5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.462892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f4bf0-88e2-48eb-8626-b688d756e5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.463398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe17a53-2dc0-49cf-bb39-3a8b641e1af7 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.464459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f4bf0-88e2-48eb-8626-b688d756e5ad admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.473284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 793/1598] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:36.474159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17a53-2dc0-49cf-bb39-3a8b641e1af7 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.474855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 806/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.475623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f4bf0-88e2-48eb-8626-b688d756e5ad admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.484501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17a53-2dc0-49cf-bb39-3a8b641e1af7 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.486485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f4bf0-88e2-48eb-8626-b688d756e5ad admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.489228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd834-0c17-462f-af6a-0cdd6e0b6e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.490413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd834-0c17-462f-af6a-0cdd6e0b6e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.490793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd834-0c17-462f-af6a-0cdd6e0b6e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.490928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd834-0c17-462f-af6a-0cdd6e0b6e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.491564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd834-0c17-462f-af6a-0cdd6e0b6e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.492284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a70eaa-770b-4008-9ee7-11b9fcb65996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.493027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a70eaa-770b-4008-9ee7-11b9fcb65996 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.493170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a70eaa-770b-4008-9ee7-11b9fcb65996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.493414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a70eaa-770b-4008-9ee7-11b9fcb65996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.493554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd834-0c17-462f-af6a-0cdd6e0b6e64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.494085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a70eaa-770b-4008-9ee7-11b9fcb65996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.495671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a70eaa-770b-4008-9ee7-11b9fcb65996 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.508796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 807/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.510705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a70eaa-770b-4008-9ee7-11b9fcb65996 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.521721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a70eaa-770b-4008-9ee7-11b9fcb65996 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.526620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf6258-6279-472c-9ede-ecfaa126bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.527218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf6258-6279-472c-9ede-ecfaa126bc7d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.527496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf6258-6279-472c-9ede-ecfaa126bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.527765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf6258-6279-472c-9ede-ecfaa126bc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.528376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 794/1601] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:36.529100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf6258-6279-472c-9ede-ecfaa126bc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.530695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf6258-6279-472c-9ede-ecfaa126bc7d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.532696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd834-0c17-462f-af6a-0cdd6e0b6e64 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.542305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 808/1602] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.543214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf6258-6279-472c-9ede-ecfaa126bc7d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.555821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf6258-6279-472c-9ede-ecfaa126bc7d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.571299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:36.596327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd834-0c17-462f-af6a-0cdd6e0b6e64 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.600480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05fb2a-f47b-4910-a727-785452d77b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.601100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fb2a-f47b-4910-a727-785452d77b4d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.601389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fb2a-f47b-4910-a727-785452d77b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.601700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fb2a-f47b-4910-a727-785452d77b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.642777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635be73-374e-4a2c-83d7-64adc10dddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.643495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635be73-374e-4a2c-83d7-64adc10dddad admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.643775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635be73-374e-4a2c-83d7-64adc10dddad admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.644051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635be73-374e-4a2c-83d7-64adc10dddad admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.644697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635be73-374e-4a2c-83d7-64adc10dddad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.646883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635be73-374e-4a2c-83d7-64adc10dddad admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.659669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 809/1603] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:36.661027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635be73-374e-4a2c-83d7-64adc10dddad admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.674125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635be73-374e-4a2c-83d7-64adc10dddad admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.675629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05fb2a-f47b-4910-a727-785452d77b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.678386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05fb2a-f47b-4910-a727-785452d77b4d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.679840 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309eac8-085d-46fb-8b46-eeb278acc801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.680411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309eac8-085d-46fb-8b46-eeb278acc801 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.680696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309eac8-085d-46fb-8b46-eeb278acc801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.681117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309eac8-085d-46fb-8b46-eeb278acc801 admin admin] PATH_INFO: `/v3/projects/6f104795d5a04f6fa7b747bbbc48ab39/users/57d8dd7c820144a082032626cb481df7/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.690283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 795/1604] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:36.691406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05fb2a-f47b-4910-a727-785452d77b4d service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.697994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309eac8-085d-46fb-8b46-eeb278acc801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f104795d5a04f6fa7b747bbbc48ab39, user_id=57d8dd7c820144a082032626cb481df7, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.700918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309eac8-085d-46fb-8b46-eeb278acc801 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.703071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05fb2a-f47b-4910-a727-785452d77b4d service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.709393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ba337-f6aa-450c-a351-5de4a80afa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.710311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba337-f6aa-450c-a351-5de4a80afa49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.710599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba337-f6aa-450c-a351-5de4a80afa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.711163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba337-f6aa-450c-a351-5de4a80afa49 admin admin] PATH_INFO: `/v3/projects/7902bf921664442cab21a7d97cbcf911/users/f4a9da2cec0d420b800b99797166893f/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.716456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 810/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:36 2022] PUT /identity/v3/projects/6f104795d5a04f6fa7b747bbbc48ab39/users/57d8dd7c820144a082032626cb481df7/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:36.717173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309eac8-085d-46fb-8b46-eeb278acc801 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.730070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ba337-f6aa-450c-a351-5de4a80afa49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7902bf921664442cab21a7d97cbcf911, user_id=f4a9da2cec0d420b800b99797166893f, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.732853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ba337-f6aa-450c-a351-5de4a80afa49 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.735525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:36.753131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 796/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:36 2022] PUT /identity/v3/projects/7902bf921664442cab21a7d97cbcf911/users/f4a9da2cec0d420b800b99797166893f/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:36.756351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ba337-f6aa-450c-a351-5de4a80afa49 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.793480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309eac8-085d-46fb-8b46-eeb278acc801 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.830491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ba337-f6aa-450c-a351-5de4a80afa49 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.835856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40289094-c01f-487e-b57a-7144e02e396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.836329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40289094-c01f-487e-b57a-7144e02e396a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.836611 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40289094-c01f-487e-b57a-7144e02e396a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.836882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40289094-c01f-487e-b57a-7144e02e396a admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.837977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40289094-c01f-487e-b57a-7144e02e396a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.840971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40289094-c01f-487e-b57a-7144e02e396a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.862223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43c0e0-d098-4090-b07f-bfeeb2d30248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.862962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43c0e0-d098-4090-b07f-bfeeb2d30248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.863246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43c0e0-d098-4090-b07f-bfeeb2d30248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.863654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43c0e0-d098-4090-b07f-bfeeb2d30248 admin admin] PATH_INFO: `/v3/projects/b75d733b34d3469f9d46d63fd0b54ca0/users/124d46b9c4d94ddfac10753c766b52b3/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.863770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 797/1607] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:36.864600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40289094-c01f-487e-b57a-7144e02e396a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.881507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40289094-c01f-487e-b57a-7144e02e396a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:36.887375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062214f-4641-4dfd-b453-a08c498dd4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:36.888247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062214f-4641-4dfd-b453-a08c498dd4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.888761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062214f-4641-4dfd-b453-a08c498dd4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.889415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062214f-4641-4dfd-b453-a08c498dd4ae admin admin] PATH_INFO: `/v3/projects/dd6cea19e05c4c0985cf0ac25e9ebf62/users/b448b15157f447cab5245efacb03e714/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.897703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43c0e0-d098-4090-b07f-bfeeb2d30248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75d733b34d3469f9d46d63fd0b54ca0, user_id=124d46b9c4d94ddfac10753c766b52b3, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.902095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43c0e0-d098-4090-b07f-bfeeb2d30248 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.912847 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062214f-4641-4dfd-b453-a08c498dd4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6cea19e05c4c0985cf0ac25e9ebf62, user_id=b448b15157f447cab5245efacb03e714, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:36.916518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062214f-4641-4dfd-b453-a08c498dd4ae admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:36.923270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 811/1608] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:36 2022] PUT /identity/v3/projects/b75d733b34d3469f9d46d63fd0b54ca0/users/124d46b9c4d94ddfac10753c766b52b3/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:36.927091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43c0e0-d098-4090-b07f-bfeeb2d30248 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:36.938847 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 798/1609] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:36 2022] PUT /identity/v3/projects/dd6cea19e05c4c0985cf0ac25e9ebf62/users/b448b15157f447cab5245efacb03e714/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:36.940493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741bed1-4eac-4a7d-9396-152e80c36d61 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:36.940969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741bed1-4eac-4a7d-9396-152e80c36d61 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:36.941440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741bed1-4eac-4a7d-9396-152e80c36d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:36.961253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:36.970696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b741bed1-4eac-4a7d-9396-152e80c36d61 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:36.973078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b741bed1-4eac-4a7d-9396-152e80c36d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:37.018744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43c0e0-d098-4090-b07f-bfeeb2d30248 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.075537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 799/1610] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:37.077332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad467b-91b6-4854-bead-5da480a2c62c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.077332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad467b-91b6-4854-bead-5da480a2c62c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.077528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad467b-91b6-4854-bead-5da480a2c62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.102126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e2ad467b-91b6-4854-bead-5da480a2c62c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:37.103708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e2ad467b-91b6-4854-bead-5da480a2c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:37.113174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 800/1611] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:37.114149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad467b-91b6-4854-bead-5da480a2c62c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:37.128869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb4461-6378-40ad-b0fe-8a52af811dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.129050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb4461-6378-40ad-b0fe-8a52af811dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.129257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb4461-6378-40ad-b0fe-8a52af811dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.129919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb4461-6378-40ad-b0fe-8a52af811dbb admin admin] PATH_INFO: `/v3/projects/7b3888c286b4411b9108cb6af3762715/users/8bc074be07ea43618b4bf1f392473fa3/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.130658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad467b-91b6-4854-bead-5da480a2c62c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.141473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111a693-be0f-42e5-9cfb-ed0ca13ae923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.142793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a693-be0f-42e5-9cfb-ed0ca13ae923 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.143782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a693-be0f-42e5-9cfb-ed0ca13ae923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.144230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a693-be0f-42e5-9cfb-ed0ca13ae923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.145052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111a693-be0f-42e5-9cfb-ed0ca13ae923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:37.147090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111a693-be0f-42e5-9cfb-ed0ca13ae923 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:37.153102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb4461-6378-40ad-b0fe-8a52af811dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3888c286b4411b9108cb6af3762715, user_id=8bc074be07ea43618b4bf1f392473fa3, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:37.156530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb4461-6378-40ad-b0fe-8a52af811dbb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:37.161283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 801/1612] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:37.163111 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10676-cd38-4474-9631-298f31b4465e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.163398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10676-cd38-4474-9631-298f31b4465e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.163807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10676-cd38-4474-9631-298f31b4465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.184153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 812/1613] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:36 2022] PUT /identity/v3/projects/7b3888c286b4411b9108cb6af3762715/users/8bc074be07ea43618b4bf1f392473fa3/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:37.186208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a511-3377-4a10-ba00-275c40074d7a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.187402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a511-3377-4a10-ba00-275c40074d7a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.187905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a511-3377-4a10-ba00-275c40074d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.198919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f2d10676-cd38-4474-9631-298f31b4465e None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:37.200074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f2d10676-cd38-4474-9631-298f31b4465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:37.235660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a7e3a511-3377-4a10-ba00-275c40074d7a None None] MFA Rules not processed for user `b448b15157f447cab5245efacb03e714`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:37.237678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a7e3a511-3377-4a10-ba00-275c40074d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:37.261124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:37.317570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 802/1614] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:37.319993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10676-cd38-4474-9631-298f31b4465e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:37.337843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 813/1615] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:37.338902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3a511-3377-4a10-ba00-275c40074d7a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:37.392712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:37.409865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3a511-3377-4a10-ba00-275c40074d7a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.414117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464b890-014d-4743-bcae-cc7800ea487c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.415080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464b890-014d-4743-bcae-cc7800ea487c service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.415646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464b890-014d-4743-bcae-cc7800ea487c service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.416082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464b890-014d-4743-bcae-cc7800ea487c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.430637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464b890-014d-4743-bcae-cc7800ea487c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:37.434673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464b890-014d-4743-bcae-cc7800ea487c service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:37.459618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10676-cd38-4474-9631-298f31b4465e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.460165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 814/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:37.461237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464b890-014d-4743-bcae-cc7800ea487c service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:37.470775 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1787bf-549c-4779-a36d-1f7692c449d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.471554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1787bf-549c-4779-a36d-1f7692c449d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.472053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1787bf-549c-4779-a36d-1f7692c449d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.472427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1787bf-549c-4779-a36d-1f7692c449d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.481748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464b890-014d-4743-bcae-cc7800ea487c service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.491748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a557d-ed3e-4a8f-b933-e1d72d8594df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.492030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1787bf-549c-4779-a36d-1f7692c449d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:37.494027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1787bf-549c-4779-a36d-1f7692c449d3 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:37.494871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a557d-ed3e-4a8f-b933-e1d72d8594df admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.495242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a557d-ed3e-4a8f-b933-e1d72d8594df admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.495607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a557d-ed3e-4a8f-b933-e1d72d8594df admin admin] PATH_INFO: `/v3/projects/127001c91ea1416fa5206926c45e2294/users/2fe66599d0404c88bd1894db00baaeb3/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.519248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 803/1617] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:37.522883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a557d-ed3e-4a8f-b933-e1d72d8594df admin admin] RBAC: Authorizing `identity:create_grant(project_id=127001c91ea1416fa5206926c45e2294, user_id=2fe66599d0404c88bd1894db00baaeb3, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:37.527036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a557d-ed3e-4a8f-b933-e1d72d8594df admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:37.527827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d9f3-114e-4940-9252-21bbccf88fea None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.529063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d9f3-114e-4940-9252-21bbccf88fea None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.529613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d9f3-114e-4940-9252-21bbccf88fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.559391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 815/1618] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:37 2022] PUT /identity/v3/projects/127001c91ea1416fa5206926c45e2294/users/2fe66599d0404c88bd1894db00baaeb3/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:37.559391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a557d-ed3e-4a8f-b933-e1d72d8594df admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:37.588199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eb88d9f3-114e-4940-9252-21bbccf88fea None None] MFA Rules not processed for user `8bc074be07ea43618b4bf1f392473fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:37.589749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb88d9f3-114e-4940-9252-21bbccf88fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:37.679432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a557d-ed3e-4a8f-b933-e1d72d8594df admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.685386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc96646-3773-4184-bb24-81b072eda93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.686830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96646-3773-4184-bb24-81b072eda93c service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.687494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96646-3773-4184-bb24-81b072eda93c service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.688437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96646-3773-4184-bb24-81b072eda93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.759830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 804/1619] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:37.759830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d9f3-114e-4940-9252-21bbccf88fea None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:37.824985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc96646-3773-4184-bb24-81b072eda93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:37.828826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc96646-3773-4184-bb24-81b072eda93c service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:37.864727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 816/1620] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:37.868347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc96646-3773-4184-bb24-81b072eda93c service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:37.887969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc96646-3773-4184-bb24-81b072eda93c service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.898476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330b938-e5f6-43c8-8541-31a9d9ad899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.900531 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b938-e5f6-43c8-8541-31a9d9ad899f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.900862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b938-e5f6-43c8-8541-31a9d9ad899f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.901303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b938-e5f6-43c8-8541-31a9d9ad899f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.901829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330b938-e5f6-43c8-8541-31a9d9ad899f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:37.905677 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330b938-e5f6-43c8-8541-31a9d9ad899f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:37.927249 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 817/1621] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:37.929402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3669d-ea87-484a-9d32-01f8fa9c2f33 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.929649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3669d-ea87-484a-9d32-01f8fa9c2f33 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.929986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3669d-ea87-484a-9d32-01f8fa9c2f33 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.931527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 818/1622] 10.222.0.15 () {54 vars in 961 bytes} [Thu Oct 6 12:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:22:37.932733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3669d-ea87-484a-9d32-01f8fa9c2f33 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:37.933948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d9f3-114e-4940-9252-21bbccf88fea None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.940264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44d86c-f638-43dd-a8a1-fb56f3202e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.940899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d86c-f638-43dd-a8a1-fb56f3202e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.941182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d86c-f638-43dd-a8a1-fb56f3202e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.941458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d86c-f638-43dd-a8a1-fb56f3202e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.942144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44d86c-f638-43dd-a8a1-fb56f3202e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:37.944201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44d86c-f638-43dd-a8a1-fb56f3202e47 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:37.968543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:37.969529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3669d-ea87-484a-9d32-01f8fa9c2f33 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:37.980265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 805/1623] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:37 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:37.982007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244885f1-c9fd-4a97-92b7-dbbef0c0303e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.982598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244885f1-c9fd-4a97-92b7-dbbef0c0303e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.983019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244885f1-c9fd-4a97-92b7-dbbef0c0303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.987892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7947-4891-44e6-884f-b50da928fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:37.990334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7947-4891-44e6-884f-b50da928fd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:37.990972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7947-4891-44e6-884f-b50da928fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:37.991259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7947-4891-44e6-884f-b50da928fd6e admin admin] PATH_INFO: `/v3/projects/127001c91ea1416fa5206926c45e2294/users/2fe66599d0404c88bd1894db00baaeb3/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:37.998993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe7947-4891-44e6-884f-b50da928fd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=127001c91ea1416fa5206926c45e2294, user_id=2fe66599d0404c88bd1894db00baaeb3, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:38.006021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe7947-4891-44e6-884f-b50da928fd6e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:38.020701 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 819/1624] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:37 2022] PUT /identity/v3/projects/127001c91ea1416fa5206926c45e2294/users/2fe66599d0404c88bd1894db00baaeb3/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:38.022473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7947-4891-44e6-884f-b50da928fd6e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:38.045956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-244885f1-c9fd-4a97-92b7-dbbef0c0303e None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:38.047940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-244885f1-c9fd-4a97-92b7-dbbef0c0303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:38.159215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 806/1625] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Oct 6 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:38.173695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b2b1-580b-428a-bfed-ff47fe2ae287 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:38.174106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b2b1-580b-428a-bfed-ff47fe2ae287 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:38.174839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b2b1-580b-428a-bfed-ff47fe2ae287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:38.175938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:38.219666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7947-4891-44e6-884f-b50da928fd6e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:38.234324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafe681-9129-43ac-9a24-534daa9043e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:38.234718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafe681-9129-43ac-9a24-534daa9043e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:38.235002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafe681-9129-43ac-9a24-534daa9043e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:38.237834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafe681-9129-43ac-9a24-534daa9043e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:38.238654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafe681-9129-43ac-9a24-534daa9043e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:38.244244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-86b8b2b1-580b-428a-bfed-ff47fe2ae287 None None] MFA Rules not processed for user `2fe66599d0404c88bd1894db00baaeb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:38.246089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafe681-9129-43ac-9a24-534daa9043e8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:38.247033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-86b8b2b1-580b-428a-bfed-ff47fe2ae287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:38.299835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 820/1626] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:38 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:38.300821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafe681-9129-43ac-9a24-534daa9043e8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:38.335198 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafe681-9129-43ac-9a24-534daa9043e8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:38.354486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bc9c9-859e-4201-88d0-6a8ad472d3c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:38.356098 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bc9c9-859e-4201-88d0-6a8ad472d3c0 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:38.356459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bc9c9-859e-4201-88d0-6a8ad472d3c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:38.356859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bc9c9-859e-4201-88d0-6a8ad472d3c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:38.446008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 807/1627] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:38.446008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b2b1-580b-428a-bfed-ff47fe2ae287 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:38.473882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b2b1-580b-428a-bfed-ff47fe2ae287 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:38.485921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce19538-94dd-47b5-aba6-167933cc74e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:38.488328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce19538-94dd-47b5-aba6-167933cc74e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:38.488922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce19538-94dd-47b5-aba6-167933cc74e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:38.490758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce19538-94dd-47b5-aba6-167933cc74e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:38.492405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce19538-94dd-47b5-aba6-167933cc74e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:38.497172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce19538-94dd-47b5-aba6-167933cc74e6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:38.512083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bc9c9-859e-4201-88d0-6a8ad472d3c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:38.513864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bc9c9-859e-4201-88d0-6a8ad472d3c0 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:38.524245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 808/1628] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:38.525567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce19538-94dd-47b5-aba6-167933cc74e6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:38.542415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 821/1629] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:38.543370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bc9c9-859e-4201-88d0-6a8ad472d3c0 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:38.574459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bc9c9-859e-4201-88d0-6a8ad472d3c0 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:38.586991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173dab2-6cc6-4f30-b9ef-b3e37ee0ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:38.589012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173dab2-6cc6-4f30-b9ef-b3e37ee0ef58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:38.590681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173dab2-6cc6-4f30-b9ef-b3e37ee0ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:38.591091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173dab2-6cc6-4f30-b9ef-b3e37ee0ef58 admin admin] PATH_INFO: `/v3/projects/a4ec27b9d68d40bcad4d252481e96052/users/47e8df5c564945ea8f95e869d4198734/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:38.628439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173dab2-6cc6-4f30-b9ef-b3e37ee0ef58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ec27b9d68d40bcad4d252481e96052, user_id=47e8df5c564945ea8f95e869d4198734, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:38.633910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173dab2-6cc6-4f30-b9ef-b3e37ee0ef58 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:38.667934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce19538-94dd-47b5-aba6-167933cc74e6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:38.674886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 822/1630] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:38 2022] PUT /identity/v3/projects/a4ec27b9d68d40bcad4d252481e96052/users/47e8df5c564945ea8f95e869d4198734/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:38.679995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173dab2-6cc6-4f30-b9ef-b3e37ee0ef58 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:38.681589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:38.805735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074eef-b741-4efa-ab2b-968a8f3c0e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:38.807815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074eef-b741-4efa-ab2b-968a8f3c0e88 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:38.808317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074eef-b741-4efa-ab2b-968a8f3c0e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:38.808597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074eef-b741-4efa-ab2b-968a8f3c0e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:38.854075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173dab2-6cc6-4f30-b9ef-b3e37ee0ef58 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:38.868255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaf83d-3b13-4713-a2bb-e391d854cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:38.871492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaf83d-3b13-4713-a2bb-e391d854cf73 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:38.871765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaf83d-3b13-4713-a2bb-e391d854cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:38.872765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaf83d-3b13-4713-a2bb-e391d854cf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:38.873571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaf83d-3b13-4713-a2bb-e391d854cf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:38.878649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaf83d-3b13-4713-a2bb-e391d854cf73 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:38.910596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 823/1631] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:38.919088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaf83d-3b13-4713-a2bb-e391d854cf73 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:38.944186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaf83d-3b13-4713-a2bb-e391d854cf73 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:38.956775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367418-badd-45b9-82e3-a6fc9f2fe516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:38.958025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367418-badd-45b9-82e3-a6fc9f2fe516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:38.958310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367418-badd-45b9-82e3-a6fc9f2fe516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:38.962674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367418-badd-45b9-82e3-a6fc9f2fe516 admin admin] PATH_INFO: `/v3/projects/a4ec27b9d68d40bcad4d252481e96052/users/47e8df5c564945ea8f95e869d4198734/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:38.970458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367418-badd-45b9-82e3-a6fc9f2fe516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ec27b9d68d40bcad4d252481e96052, user_id=47e8df5c564945ea8f95e869d4198734, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:38.977771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367418-badd-45b9-82e3-a6fc9f2fe516 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:38.979057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62074eef-b741-4efa-ab2b-968a8f3c0e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:38.981304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62074eef-b741-4efa-ab2b-968a8f3c0e88 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:39.002290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 809/1632] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:39.004944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 824/1633] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:38 2022] PUT /identity/v3/projects/a4ec27b9d68d40bcad4d252481e96052/users/47e8df5c564945ea8f95e869d4198734/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:39.016310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c49cb-4103-40b9-9d40-7110e0b59ee4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:39.016562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c49cb-4103-40b9-9d40-7110e0b59ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:39.016816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c49cb-4103-40b9-9d40-7110e0b59ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:39.051164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c06c49cb-4103-40b9-9d40-7110e0b59ee4 None None] MFA Rules not processed for user `47e8df5c564945ea8f95e869d4198734`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:39.052410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c06c49cb-4103-40b9-9d40-7110e0b59ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:39.206072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 810/1634] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:39.218909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367418-badd-45b9-82e3-a6fc9f2fe516 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:39.239821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c49cb-4103-40b9-9d40-7110e0b59ee4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:39.309161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:39.369153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:39.370955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367418-badd-45b9-82e3-a6fc9f2fe516 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:39.376987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7c287-21e6-4435-9054-f23df43b958c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:39.378125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7c287-21e6-4435-9054-f23df43b958c service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:39.378581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7c287-21e6-4435-9054-f23df43b958c service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:39.379014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7c287-21e6-4435-9054-f23df43b958c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:39.397271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c49cb-4103-40b9-9d40-7110e0b59ee4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:39.404726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7c287-21e6-4435-9054-f23df43b958c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:39.407338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:39.408582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:39.409445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7c287-21e6-4435-9054-f23df43b958c service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:39.409849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:39.412348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] PATH_INFO: `/v3/users/32511aa67a264334b960faa7e5d72bba` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:39.416058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32511aa67a264334b960faa7e5d72bba)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:39.418522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:39.437229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 825/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:39.439083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1831e96-8fa7-4922-80cf-fc7fe6c27416 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:39.439860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1831e96-8fa7-4922-80cf-fc7fe6c27416 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:39.439860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1831e96-8fa7-4922-80cf-fc7fe6c27416 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:39.446812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 826/1636] 10.222.0.15 () {54 vars in 961 bytes} [Thu Oct 6 12:22:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:22:39.455546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce2aa-c7ef-4a69-8091-45f89a12218a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:39.455925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce2aa-c7ef-4a69-8091-45f89a12218a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:39.456312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce2aa-c7ef-4a69-8091-45f89a12218a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:39.522931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0f3ce2aa-c7ef-4a69-8091-45f89a12218a None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:39.527950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0f3ce2aa-c7ef-4a69-8091-45f89a12218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:39.532507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32511aa67a264334b960faa7e5d72bba'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:39.533987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32511aa67a264334b960faa7e5d72bba'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:39.548611 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32511aa67a264334b960faa7e5d72bba'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:39.586985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32511aa67a264334b960faa7e5d72bba'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:39.604838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c375852b-b2bf-4f5b-81c7-2939e1ab269e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32511aa67a264334b960faa7e5d72bba'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:39.621633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 811/1637] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:39 2022] DELETE /identity/v3/users/32511aa67a264334b960faa7e5d72bba => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:22:39.625359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0e43-484c-4026-ab56-8059e65a72b0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:39.625817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0e43-484c-4026-ab56-8059e65a72b0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:39.626190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0e43-484c-4026-ab56-8059e65a72b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:39.686643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6aaf0e43-484c-4026-ab56-8059e65a72b0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:39.694731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6aaf0e43-484c-4026-ab56-8059e65a72b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:39.796497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 827/1638] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Oct 6 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:22:39.803724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8e13-c855-4db5-8ea3-206a276bf4a7 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:39.804116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8e13-c855-4db5-8ea3-206a276bf4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:39.804498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8e13-c855-4db5-8ea3-206a276bf4a7 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:39.809522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 828/1639] 10.222.0.15 () {54 vars in 912 bytes} [Thu Oct 6 12:22:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:22:39.814823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97d29-c774-4598-a86e-391db8ba58b6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:39.815230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97d29-c774-4598-a86e-391db8ba58b6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:39.815614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97d29-c774-4598-a86e-391db8ba58b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:39.846445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-48c97d29-c774-4598-a86e-391db8ba58b6 None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:39.848468 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-48c97d29-c774-4598-a86e-391db8ba58b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:39.897608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 812/1640] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:39.949218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 829/1641] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:39.964108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf0e43-484c-4026-ab56-8059e65a72b0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:39.966405 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97d29-c774-4598-a86e-391db8ba58b6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:39.966555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6aaf0e43-484c-4026-ab56-8059e65a72b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:39.968168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-48c97d29-c774-4598-a86e-391db8ba58b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:40.107314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97d29-c774-4598-a86e-391db8ba58b6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:40.114315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf0e43-484c-4026-ab56-8059e65a72b0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:40.118424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192cd72-dd5b-44de-8705-4b8cf408b08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:40.119199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192cd72-dd5b-44de-8705-4b8cf408b08b service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:40.120237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192cd72-dd5b-44de-8705-4b8cf408b08b service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:40.121053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192cd72-dd5b-44de-8705-4b8cf408b08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:40.124702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8bc81-3878-4aa4-a083-53ba8752e957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:40.126553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8bc81-3878-4aa4-a083-53ba8752e957 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:40.128244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8bc81-3878-4aa4-a083-53ba8752e957 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:40.128244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8bc81-3878-4aa4-a083-53ba8752e957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:40.149259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8bc81-3878-4aa4-a083-53ba8752e957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:40.150999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8bc81-3878-4aa4-a083-53ba8752e957 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:40.160194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192cd72-dd5b-44de-8705-4b8cf408b08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:40.164639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192cd72-dd5b-44de-8705-4b8cf408b08b service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:40.179093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:40.183551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 813/1642] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:40.190403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 830/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:22:40.417942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d45817-01a4-4c09-b09c-b600d0eeff9e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:40.418353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d45817-01a4-4c09-b09c-b600d0eeff9e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:40.422183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d45817-01a4-4c09-b09c-b600d0eeff9e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:40.430348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 814/1644] 10.222.0.15 () {54 vars in 912 bytes} [Thu Oct 6 12:22:40 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:22:40.440933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946412f7-a9ea-45b3-a0cc-cb13f0bd66ea None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:40.443910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946412f7-a9ea-45b3-a0cc-cb13f0bd66ea None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:40.445319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946412f7-a9ea-45b3-a0cc-cb13f0bd66ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:40.510900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-946412f7-a9ea-45b3-a0cc-cb13f0bd66ea None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:40.513892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-946412f7-a9ea-45b3-a0cc-cb13f0bd66ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:40.550355 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 831/1645] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:40.570643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d45817-01a4-4c09-b09c-b600d0eeff9e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:40.572552 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-56d45817-01a4-4c09-b09c-b600d0eeff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:40.602963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d45817-01a4-4c09-b09c-b600d0eeff9e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:40.615242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eae63f-c839-4bcc-88c3-f2923a6a23a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:40.615930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae63f-c839-4bcc-88c3-f2923a6a23a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:40.616222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae63f-c839-4bcc-88c3-f2923a6a23a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:40.616585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae63f-c839-4bcc-88c3-f2923a6a23a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:40.629583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:40.642206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eae63f-c839-4bcc-88c3-f2923a6a23a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:40.654345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eae63f-c839-4bcc-88c3-f2923a6a23a5 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:40.666377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 815/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:22:40.936137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946412f7-a9ea-45b3-a0cc-cb13f0bd66ea None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:40.938314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-946412f7-a9ea-45b3-a0cc-cb13f0bd66ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:40.997917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946412f7-a9ea-45b3-a0cc-cb13f0bd66ea None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:41.003628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:41.004463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:41.005165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:41.005908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] PATH_INFO: `/v3/users/8bc074be07ea43618b4bf1f392473fa3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:41.007422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc074be07ea43618b4bf1f392473fa3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:41.008672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: WARNING py.warnings [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:22:41.008672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: warnings.warn(msg) Oct 06 12:22:41.008672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: Oct 06 12:22:41.010367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:41.156438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc074be07ea43618b4bf1f392473fa3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:41.157242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc074be07ea43618b4bf1f392473fa3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:41.157849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc074be07ea43618b4bf1f392473fa3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:41.195913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc074be07ea43618b4bf1f392473fa3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:41.215232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc074be07ea43618b4bf1f392473fa3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:41.258556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 832/1647] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:40 2022] DELETE /identity/v3/users/8bc074be07ea43618b4bf1f392473fa3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:41.263463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384989f-4e11-47eb-b347-e7f828059498 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:41.264005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384989f-4e11-47eb-b347-e7f828059498 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:41.264005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384989f-4e11-47eb-b347-e7f828059498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:41.308793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7384989f-4e11-47eb-b347-e7f828059498 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:41.312577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7384989f-4e11-47eb-b347-e7f828059498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:41.473228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 816/1648] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:22:41.539256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:41.540873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:41.735827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a469f9-e06c-46f7-add5-a34f0451c131 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:41.747242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7334f-4ed7-4a67-8473-fd4391e5d595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:41.748289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7334f-4ed7-4a67-8473-fd4391e5d595 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:41.748402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7334f-4ed7-4a67-8473-fd4391e5d595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:41.751112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7334f-4ed7-4a67-8473-fd4391e5d595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:41.794481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7334f-4ed7-4a67-8473-fd4391e5d595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:41.796566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7334f-4ed7-4a67-8473-fd4391e5d595 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:41.815887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 833/1649] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:42.443685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384989f-4e11-47eb-b347-e7f828059498 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:42.446457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7384989f-4e11-47eb-b347-e7f828059498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:42.490921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384989f-4e11-47eb-b347-e7f828059498 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:42.509412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:42.512367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:42.513279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:42.514497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] PATH_INFO: `/v3/users/b448b15157f447cab5245efacb03e714` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:42.518087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b448b15157f447cab5245efacb03e714)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:42.530503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:42.669781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b448b15157f447cab5245efacb03e714'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:42.670819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b448b15157f447cab5245efacb03e714'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:42.689030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b448b15157f447cab5245efacb03e714'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:42.716203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b448b15157f447cab5245efacb03e714'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:42.730327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b448b15157f447cab5245efacb03e714'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:42.745858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 817/1650] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:42 2022] DELETE /identity/v3/users/b448b15157f447cab5245efacb03e714 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:42.747761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af137-db46-4c27-b011-30faa8708663 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:42.748195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af137-db46-4c27-b011-30faa8708663 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:42.748195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6af137-db46-4c27-b011-30faa8708663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:42.753042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:42.754496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:42.789126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7b6af137-db46-4c27-b011-30faa8708663 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:42.789644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7b6af137-db46-4c27-b011-30faa8708663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:42.873349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bd1e0-2dc8-43b7-9395-488b7d71be0a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:42.886384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:42.887241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:42.887623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:42.889148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] PATH_INFO: `/v3/projects/838a60cbb3fb40c7877dde30d3339ee8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:42.890493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=838a60cbb3fb40c7877dde30d3339ee8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:42.894077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 06 12:22:42.894077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 06 12:22:42.894077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: Oct 06 12:22:42.896369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:42.915321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:42.965620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 834/1651] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:43.032259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838a60cbb3fb40c7877dde30d3339ee8', 'request_id': 'req-7b60a4fc-db2b-4b52-bc78-e5899868beaa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.046009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838a60cbb3fb40c7877dde30d3339ee8', 'request_id': 'req-7b60a4fc-db2b-4b52-bc78-e5899868beaa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.058352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838a60cbb3fb40c7877dde30d3339ee8', 'request_id': 'req-7b60a4fc-db2b-4b52-bc78-e5899868beaa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.103833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] The token cache is being invalidate because project 838a60cbb3fb40c7877dde30d3339ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:43.104218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.110370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.112581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 818/1652] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:42 2022] DELETE /identity/v3/projects/838a60cbb3fb40c7877dde30d3339ee8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:22:43.117021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6af137-db46-4c27-b011-30faa8708663 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:43.135074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6af137-db46-4c27-b011-30faa8708663 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:43.147793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:43.201076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:43.202793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:43.280440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:43.282061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:43.283945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:43.285094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] PATH_INFO: `/v3/users/2fe66599d0404c88bd1894db00baaeb3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:43.288989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe66599d0404c88bd1894db00baaeb3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:43.295815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:43.326227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60a4fc-db2b-4b52-bc78-e5899868beaa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:43.336468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:43.337359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:43.337732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:43.338142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:43.341322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:43.376315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:43.378009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:43.399997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 819/1653] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:22:43.409241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe66599d0404c88bd1894db00baaeb3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.412033 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe66599d0404c88bd1894db00baaeb3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.414489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe66599d0404c88bd1894db00baaeb3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.449787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe66599d0404c88bd1894db00baaeb3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.469630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe66599d0404c88bd1894db00baaeb3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:43.499026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 835/1654] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:43 2022] DELETE /identity/v3/users/2fe66599d0404c88bd1894db00baaeb3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:44.438232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:44.440315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:44.463726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0ff64-81ce-4246-8e0f-e073841b477c service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:44.616772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:44.618578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:44.619124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:44.619505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] PATH_INFO: `/v3/projects/7b3888c286b4411b9108cb6af3762715` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:44.637120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3888c286b4411b9108cb6af3762715)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:44.641306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:44.734226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:44.748943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3888c286b4411b9108cb6af3762715', 'request_id': 'req-bb291de1-0736-4d94-be6e-0dc38cdbbd79'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:44.750291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:44.758372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:44.766125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3888c286b4411b9108cb6af3762715', 'request_id': 'req-bb291de1-0736-4d94-be6e-0dc38cdbbd79'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:44.783654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3888c286b4411b9108cb6af3762715', 'request_id': 'req-bb291de1-0736-4d94-be6e-0dc38cdbbd79'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:44.799291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6821573-89a9-49a9-ac60-52476964299e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:44.818695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] The token cache is being invalidate because project 7b3888c286b4411b9108cb6af3762715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:44.819202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:44.821915 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bb291de1-0736-4d94-be6e-0dc38cdbbd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:44.829398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 820/1655] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:44 2022] DELETE /identity/v3/projects/7b3888c286b4411b9108cb6af3762715 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:44.832709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345505-a7d2-4274-af9f-cacb80df64f3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:44.834249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345505-a7d2-4274-af9f-cacb80df64f3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:44.835200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345505-a7d2-4274-af9f-cacb80df64f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:44.893714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b3345505-a7d2-4274-af9f-cacb80df64f3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:44.898079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b3345505-a7d2-4274-af9f-cacb80df64f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:44.994486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:44.997218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.003693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.004192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] PATH_INFO: `/v3/projects/127001c91ea1416fa5206926c45e2294` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.006281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127001c91ea1416fa5206926c45e2294)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:45.009106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:45.087482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:45.111682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 821/1656] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:45.120087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee85a57-4016-4191-9f74-4d64f74bc68f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.120391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee85a57-4016-4191-9f74-4d64f74bc68f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.121526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee85a57-4016-4191-9f74-4d64f74bc68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.145298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127001c91ea1416fa5206926c45e2294', 'request_id': 'req-4cec5076-3377-4650-a9ce-c08b757f8361'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.162926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127001c91ea1416fa5206926c45e2294', 'request_id': 'req-4cec5076-3377-4650-a9ce-c08b757f8361'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.173641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0ee85a57-4016-4191-9f74-4d64f74bc68f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:45.174893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127001c91ea1416fa5206926c45e2294', 'request_id': 'req-4cec5076-3377-4650-a9ce-c08b757f8361'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.176588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0ee85a57-4016-4191-9f74-4d64f74bc68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:45.215075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] The token cache is being invalidate because project 127001c91ea1416fa5206926c45e2294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:45.215524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.216410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cec5076-3377-4650-a9ce-c08b757f8361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.220642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 836/1657] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:44 2022] DELETE /identity/v3/projects/127001c91ea1416fa5206926c45e2294 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:22:45.226496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32b66a-198e-4213-8613-3227dd6595e9 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.226863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32b66a-198e-4213-8613-3227dd6595e9 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.227145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32b66a-198e-4213-8613-3227dd6595e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.273524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6f32b66a-198e-4213-8613-3227dd6595e9 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:45.275055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6f32b66a-198e-4213-8613-3227dd6595e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:45.358474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 822/1658] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:45.359507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee85a57-4016-4191-9f74-4d64f74bc68f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.379477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee85a57-4016-4191-9f74-4d64f74bc68f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:45.393797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:45.394823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.395300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.396770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.397733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:45.398203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:45.400735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:45.435079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 823/1659] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:45.437161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.448645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 837/1660] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:45.459016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05d0b8-7ab5-4ab7-8bd4-b855175e62b7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.459517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05d0b8-7ab5-4ab7-8bd4-b855175e62b7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.460148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05d0b8-7ab5-4ab7-8bd4-b855175e62b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.471510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671d60b-b11e-42f9-a945-3bcede051e22 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:45.480262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eea61e-ff34-4e17-b696-3931fe0f2876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:45.481194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea61e-ff34-4e17-b696-3931fe0f2876 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.481479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea61e-ff34-4e17-b696-3931fe0f2876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.481884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea61e-ff34-4e17-b696-3931fe0f2876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.483091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eea61e-ff34-4e17-b696-3931fe0f2876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:45.485217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eea61e-ff34-4e17-b696-3931fe0f2876 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:45.505224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-db05d0b8-7ab5-4ab7-8bd4-b855175e62b7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:45.506889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-db05d0b8-7ab5-4ab7-8bd4-b855175e62b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:45.525357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 824/1661] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:45 2022] POST /identity/v3/projects => generated 403 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:45.527480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 838/1662] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:22:45.532167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05d0b8-7ab5-4ab7-8bd4-b855175e62b7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.533124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eea61e-ff34-4e17-b696-3931fe0f2876 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.550930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05d0b8-7ab5-4ab7-8bd4-b855175e62b7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:45.593585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:45.632496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eea61e-ff34-4e17-b696-3931fe0f2876 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:45.639883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:45.640507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.640803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.641737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.642397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:45.648426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:45.679409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:45.680052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.680337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.680615 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.681288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:45.681614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:45.683847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:45.693864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 825/1663] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:45 2022] POST /identity/v3/users => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:45.693864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.694226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:45.706812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 839/1664] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:45.709038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.717112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189557b-3b69-4642-ab2b-33103129d3d0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:45.722963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:45.723831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.724083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.724367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] PATH_INFO: `/v3/projects/dd6cea19e05c4c0985cf0ac25e9ebf62` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.725779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd6cea19e05c4c0985cf0ac25e9ebf62)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:45.729192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:45.731985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e392c1-7b19-4d26-b44e-52c3f4cecb2a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:45.745643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d7c07-ccc0-44e8-a6ca-1a49d3925717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:45.746243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d7c07-ccc0-44e8-a6ca-1a49d3925717 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.746526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d7c07-ccc0-44e8-a6ca-1a49d3925717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.746806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d7c07-ccc0-44e8-a6ca-1a49d3925717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.747467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d7c07-ccc0-44e8-a6ca-1a49d3925717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:45.749121 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d7c07-ccc0-44e8-a6ca-1a49d3925717 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:45.769067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 840/1665] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:45.769967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d7c07-ccc0-44e8-a6ca-1a49d3925717 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.792171 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d7c07-ccc0-44e8-a6ca-1a49d3925717 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:45.806916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd6cea19e05c4c0985cf0ac25e9ebf62', 'request_id': 'req-ca1947ae-3a37-4cea-8ca8-318637e9db32'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.821644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd6cea19e05c4c0985cf0ac25e9ebf62', 'request_id': 'req-ca1947ae-3a37-4cea-8ca8-318637e9db32'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.836523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd6cea19e05c4c0985cf0ac25e9ebf62', 'request_id': 'req-ca1947ae-3a37-4cea-8ca8-318637e9db32'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.855037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] The token cache is being invalidate because project dd6cea19e05c4c0985cf0ac25e9ebf62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:45.855621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.856460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:45.861402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 826/1666] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:45 2022] DELETE /identity/v3/projects/dd6cea19e05c4c0985cf0ac25e9ebf62 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:45.862581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.864170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:45.878014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:45.926265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:45.927017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:45.927305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:45.927586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:45.928283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:45.932587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:45.989880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 841/1667] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:45 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:45.991006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:45.995872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:46.020633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1947ae-3a37-4cea-8ca8-318637e9db32 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:46.146313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:46.159991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:46.161314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:46.161914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:46.163166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:46.164043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:46.172987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:46.204529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 827/1668] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:46.207220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:46.213791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:46.240942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397142a-25b4-4a2c-968f-e35d60624334 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:46.251481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:46.252155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:46.252438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:46.252712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] PATH_INFO: `/v3/users/47e8df5c564945ea8f95e869d4198734` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:46.254295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e8df5c564945ea8f95e869d4198734)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:46.256363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:46.268587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a848c-6129-4119-abcd-a7ee47b1c19e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:46.274816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9cb02-b402-4e7a-8695-33af86a1ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:46.275876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9cb02-b402-4e7a-8695-33af86a1ada5 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:46.276800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9cb02-b402-4e7a-8695-33af86a1ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:46.277245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9cb02-b402-4e7a-8695-33af86a1ada5 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:46.319839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9cb02-b402-4e7a-8695-33af86a1ada5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:46.331148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9cb02-b402-4e7a-8695-33af86a1ada5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:46.428457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 828/1669] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:46 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:46.430774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9cb02-b402-4e7a-8695-33af86a1ada5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:46.435151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e8df5c564945ea8f95e869d4198734'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:46.439758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e8df5c564945ea8f95e869d4198734'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:46.440207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e8df5c564945ea8f95e869d4198734'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:46.475643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9cb02-b402-4e7a-8695-33af86a1ada5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:46.517448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060aad-cd53-402f-8bc6-455d998e3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:46.518210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060aad-cd53-402f-8bc6-455d998e3cae admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:46.518658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060aad-cd53-402f-8bc6-455d998e3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:46.518944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060aad-cd53-402f-8bc6-455d998e3cae admin admin] PATH_INFO: `/v3/projects/6609095be2bf4120b0177ba5925978b8/users/10fb21d7001a4a5c96dda6a8295101d3/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:46.547325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e8df5c564945ea8f95e869d4198734'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:46.579502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e8df5c564945ea8f95e869d4198734'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:46.592096 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6060aad-cd53-402f-8bc6-455d998e3cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6609095be2bf4120b0177ba5925978b8, user_id=10fb21d7001a4a5c96dda6a8295101d3, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:46.601661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6060aad-cd53-402f-8bc6-455d998e3cae admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:46.628733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 842/1670] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:45 2022] DELETE /identity/v3/users/47e8df5c564945ea8f95e869d4198734 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:46.628733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:46.634022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:46.648438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 829/1671] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:46 2022] PUT /identity/v3/projects/6609095be2bf4120b0177ba5925978b8/users/10fb21d7001a4a5c96dda6a8295101d3/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:46.663686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79ec4a-9045-45e4-988f-441a9bf9202c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:46.663976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79ec4a-9045-45e4-988f-441a9bf9202c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:46.664254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79ec4a-9045-45e4-988f-441a9bf9202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:46.731969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-de79ec4a-9045-45e4-988f-441a9bf9202c None None] MFA Rules not processed for user `10fb21d7001a4a5c96dda6a8295101d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:46.750354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de79ec4a-9045-45e4-988f-441a9bf9202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:46.766652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:46.830555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69977601-0d79-4a38-908f-cf405d2f75dc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:46.894908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 830/1672] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:46.896803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79ec4a-9045-45e4-988f-441a9bf9202c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:46.898792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de79ec4a-9045-45e4-988f-441a9bf9202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:46.967779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e701ac2-8197-459d-8792-d2ea760c9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:46.968549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e701ac2-8197-459d-8792-d2ea760c9743 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:46.968893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e701ac2-8197-459d-8792-d2ea760c9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:46.969284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e701ac2-8197-459d-8792-d2ea760c9743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:46.970111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e701ac2-8197-459d-8792-d2ea760c9743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:46.976154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e701ac2-8197-459d-8792-d2ea760c9743 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:47.003443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 843/1673] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:47.007827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e701ac2-8197-459d-8792-d2ea760c9743 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:47.027855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e701ac2-8197-459d-8792-d2ea760c9743 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:47.046126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79ec4a-9045-45e4-988f-441a9bf9202c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:47.055037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1ba1-c2e1-434f-b6bb-05c41c05cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:47.055698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dfe06-1b4e-4859-8847-3dc101b17509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:47.056493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1ba1-c2e1-434f-b6bb-05c41c05cd6e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:47.056880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dfe06-1b4e-4859-8847-3dc101b17509 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:47.058267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1ba1-c2e1-434f-b6bb-05c41c05cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:47.059318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1ba1-c2e1-434f-b6bb-05c41c05cd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:47.059871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dfe06-1b4e-4859-8847-3dc101b17509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:47.060751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dfe06-1b4e-4859-8847-3dc101b17509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:47.060970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1ba1-c2e1-434f-b6bb-05c41c05cd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:47.063414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dfe06-1b4e-4859-8847-3dc101b17509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:47.065752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1ba1-c2e1-434f-b6bb-05c41c05cd6e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:47.066508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dfe06-1b4e-4859-8847-3dc101b17509 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:47.111325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 844/1674] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:47.112817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1ba1-c2e1-434f-b6bb-05c41c05cd6e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:47.129166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 831/1675] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:46 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:47.130677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dfe06-1b4e-4859-8847-3dc101b17509 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:47.138669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1ba1-c2e1-434f-b6bb-05c41c05cd6e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:47.218817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:47.277396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3898fc3-1f69-451f-89ca-c8de9aea1214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:47.281205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3898fc3-1f69-451f-89ca-c8de9aea1214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:47.281697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3898fc3-1f69-451f-89ca-c8de9aea1214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:47.283200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3898fc3-1f69-451f-89ca-c8de9aea1214 admin admin] PATH_INFO: `/v3/projects/3e7e9afaaf58490c84df049f54decfa4/users/095421afae6444f9aadead8692657367/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:47.319255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3898fc3-1f69-451f-89ca-c8de9aea1214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7e9afaaf58490c84df049f54decfa4, user_id=095421afae6444f9aadead8692657367, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:47.322940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3898fc3-1f69-451f-89ca-c8de9aea1214 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:47.323437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dfe06-1b4e-4859-8847-3dc101b17509 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:47.331781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa766ded-8161-4f60-ab81-0adcf8fa8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:47.334653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa766ded-8161-4f60-ab81-0adcf8fa8642 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:47.334971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa766ded-8161-4f60-ab81-0adcf8fa8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:47.335255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa766ded-8161-4f60-ab81-0adcf8fa8642 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:47.337217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa766ded-8161-4f60-ab81-0adcf8fa8642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:47.346523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa766ded-8161-4f60-ab81-0adcf8fa8642 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:47.355193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 845/1676] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:47 2022] PUT /identity/v3/projects/3e7e9afaaf58490c84df049f54decfa4/users/095421afae6444f9aadead8692657367/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:47.369937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a56d3-0f8f-4cd1-afc5-880dc4d5df91 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:47.370269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a56d3-0f8f-4cd1-afc5-880dc4d5df91 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:47.370494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a56d3-0f8f-4cd1-afc5-880dc4d5df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:47.418323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 832/1677] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:47 2022] POST /identity/v3/users => generated 309 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:47.419367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa766ded-8161-4f60-ab81-0adcf8fa8642 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:47.443911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa766ded-8161-4f60-ab81-0adcf8fa8642 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:47.456343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-092a56d3-0f8f-4cd1-afc5-880dc4d5df91 None None] MFA Rules not processed for user `095421afae6444f9aadead8692657367`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:47.459588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-092a56d3-0f8f-4cd1-afc5-880dc4d5df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:47.608966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cad97-c4e1-4acc-a2ca-bb3d34a8547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:47.609839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cad97-c4e1-4acc-a2ca-bb3d34a8547e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:47.610229 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cad97-c4e1-4acc-a2ca-bb3d34a8547e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:47.610424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cad97-c4e1-4acc-a2ca-bb3d34a8547e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:47.611106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cad97-c4e1-4acc-a2ca-bb3d34a8547e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:47.620718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cad97-c4e1-4acc-a2ca-bb3d34a8547e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:47.628350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:47.685959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 833/1678] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:47.687250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cad97-c4e1-4acc-a2ca-bb3d34a8547e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:47.745404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cad97-c4e1-4acc-a2ca-bb3d34a8547e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:47.748841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 846/1679] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:47.750152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a56d3-0f8f-4cd1-afc5-880dc4d5df91 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:47.766354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f1d-9bc2-464f-bfab-f42b0777a8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:47.767104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f1d-9bc2-464f-bfab-f42b0777a8f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:47.768371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f1d-9bc2-464f-bfab-f42b0777a8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:47.768685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f1d-9bc2-464f-bfab-f42b0777a8f8 admin admin] PATH_INFO: `/v3/projects/422b43300c7042d592ea6fec8b70f5be/users/f1cfe30eaaec47f28a6778b4569ad9e9/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:47.784922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a56d3-0f8f-4cd1-afc5-880dc4d5df91 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:47.804568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c24b8-c2db-4eb8-b88c-922d335bc7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:47.805212 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c24b8-c2db-4eb8-b88c-922d335bc7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:47.805497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c24b8-c2db-4eb8-b88c-922d335bc7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:47.805810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c24b8-c2db-4eb8-b88c-922d335bc7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:47.806474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c24b8-c2db-4eb8-b88c-922d335bc7b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:47.812004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c0f1d-9bc2-464f-bfab-f42b0777a8f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422b43300c7042d592ea6fec8b70f5be, user_id=f1cfe30eaaec47f28a6778b4569ad9e9, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:47.819732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c24b8-c2db-4eb8-b88c-922d335bc7b5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:47.823647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c0f1d-9bc2-464f-bfab-f42b0777a8f8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:47.872559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 834/1680] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:47 2022] PUT /identity/v3/projects/422b43300c7042d592ea6fec8b70f5be/users/f1cfe30eaaec47f28a6778b4569ad9e9/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:47.878289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f1d-9bc2-464f-bfab-f42b0777a8f8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:47.922583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 847/1681] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:47 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:47.928599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c24b8-c2db-4eb8-b88c-922d335bc7b5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:48.108812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f1d-9bc2-464f-bfab-f42b0777a8f8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:48.174353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:48.187126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c24b8-c2db-4eb8-b88c-922d335bc7b5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:48.201325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:48.202102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.202391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.202722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.203385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:48.205446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:48.249781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 848/1682] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:47 2022] POST /identity/v3/users => generated 300 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:48.252680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:48.257076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:48.267360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fc48a-9a66-4674-b0f4-701dcde7b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:48.268194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc48a-9a66-4674-b0f4-701dcde7b98e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.270258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc48a-9a66-4674-b0f4-701dcde7b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.270924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc48a-9a66-4674-b0f4-701dcde7b98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.271775 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fc48a-9a66-4674-b0f4-701dcde7b98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:48.274514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fc48a-9a66-4674-b0f4-701dcde7b98e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:48.289376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17aa897-0b44-476e-8fad-67b561567d94 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:48.300984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:48.302352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 835/1683] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:48.303149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.303604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.304397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fc48a-9a66-4674-b0f4-701dcde7b98e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:48.304822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] PATH_INFO: `/v3/projects/a4ec27b9d68d40bcad4d252481e96052` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.309793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ec27b9d68d40bcad4d252481e96052)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:48.312083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:48.329236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fc48a-9a66-4674-b0f4-701dcde7b98e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:48.340526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4a7-8207-4e8b-aa90-08947cc1197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:48.340760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4a7-8207-4e8b-aa90-08947cc1197b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.341001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4a7-8207-4e8b-aa90-08947cc1197b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.341181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4a7-8207-4e8b-aa90-08947cc1197b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.341882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961b4a7-8207-4e8b-aa90-08947cc1197b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:48.344545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961b4a7-8207-4e8b-aa90-08947cc1197b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:48.371247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 836/1684] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:48.373973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4a7-8207-4e8b-aa90-08947cc1197b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:48.402406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4a7-8207-4e8b-aa90-08947cc1197b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:48.430604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ec27b9d68d40bcad4d252481e96052', 'request_id': 'req-97f16649-6fdd-4429-8584-f1cec2045104'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:48.450871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ec27b9d68d40bcad4d252481e96052', 'request_id': 'req-97f16649-6fdd-4429-8584-f1cec2045104'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:48.467851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ec27b9d68d40bcad4d252481e96052', 'request_id': 'req-97f16649-6fdd-4429-8584-f1cec2045104'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:48.490101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] The token cache is being invalidate because project a4ec27b9d68d40bcad4d252481e96052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:48.490394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:48.492046 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:48.493887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 849/1685] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:48 2022] DELETE /identity/v3/projects/a4ec27b9d68d40bcad4d252481e96052 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:48.494873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:48.496145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:48.553024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5fd87-3526-4be7-a270-7f1514e1fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:48.553874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5fd87-3526-4be7-a270-7f1514e1fa95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.554189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5fd87-3526-4be7-a270-7f1514e1fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.555596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5fd87-3526-4be7-a270-7f1514e1fa95 admin admin] PATH_INFO: `/v3/projects/422b43300c7042d592ea6fec8b70f5be/users/f1cfe30eaaec47f28a6778b4569ad9e9/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.562606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5fd87-3526-4be7-a270-7f1514e1fa95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422b43300c7042d592ea6fec8b70f5be, user_id=f1cfe30eaaec47f28a6778b4569ad9e9, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:48.570108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5fd87-3526-4be7-a270-7f1514e1fa95 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:48.574963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:48.608965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 837/1686] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:48 2022] PUT /identity/v3/projects/422b43300c7042d592ea6fec8b70f5be/users/f1cfe30eaaec47f28a6778b4569ad9e9/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:48.621861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f55b-b089-4a4c-838c-3415f75e2ab0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.622544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f55b-b089-4a4c-838c-3415f75e2ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.622544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f55b-b089-4a4c-838c-3415f75e2ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.645042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5be1f55b-b089-4a4c-838c-3415f75e2ab0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:48.647386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5be1f55b-b089-4a4c-838c-3415f75e2ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:48.648484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16649-6fdd-4429-8584-f1cec2045104 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:48.757574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67813649-a8ef-43f6-9348-d69dc094c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:48.758687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813649-a8ef-43f6-9348-d69dc094c4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.759139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813649-a8ef-43f6-9348-d69dc094c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.760088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813649-a8ef-43f6-9348-d69dc094c4d3 admin admin] PATH_INFO: `/v3/projects/3b7c213e843b45ad9b688da360688ec7/users/e37f437c8d0b4ee6b102fb55f6787c5a/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.801369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 838/1687] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:48.803332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25bb7d-4384-479b-93ed-551d8ec89e09 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.804120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25bb7d-4384-479b-93ed-551d8ec89e09 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.804120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25bb7d-4384-479b-93ed-551d8ec89e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.810676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67813649-a8ef-43f6-9348-d69dc094c4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7c213e843b45ad9b688da360688ec7, user_id=e37f437c8d0b4ee6b102fb55f6787c5a, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:48.822045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67813649-a8ef-43f6-9348-d69dc094c4d3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:48.848519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 850/1688] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:48 2022] PUT /identity/v3/projects/3b7c213e843b45ad9b688da360688ec7/users/e37f437c8d0b4ee6b102fb55f6787c5a/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:48.859839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60072d-6f35-4017-98de-6cd639bc1cfe None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:48.860258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60072d-6f35-4017-98de-6cd639bc1cfe None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:48.863665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60072d-6f35-4017-98de-6cd639bc1cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:48.921967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8d25bb7d-4384-479b-93ed-551d8ec89e09 None None] MFA Rules not processed for user `f1cfe30eaaec47f28a6778b4569ad9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:48.923213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-fe60072d-6f35-4017-98de-6cd639bc1cfe None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:48.924697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fe60072d-6f35-4017-98de-6cd639bc1cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:48.937167 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8d25bb7d-4384-479b-93ed-551d8ec89e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:49.094038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:49.109454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 851/1689] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:49.113755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60072d-6f35-4017-98de-6cd639bc1cfe None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:49.140997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60072d-6f35-4017-98de-6cd639bc1cfe None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:49.150393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e4f3a-8dca-4ff7-ab33-8b2bbc1fd70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:49.151029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e4f3a-8dca-4ff7-ab33-8b2bbc1fd70d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:49.151308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e4f3a-8dca-4ff7-ab33-8b2bbc1fd70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:49.151605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e4f3a-8dca-4ff7-ab33-8b2bbc1fd70d admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:49.156433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e4f3a-8dca-4ff7-ab33-8b2bbc1fd70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:49.158251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e4f3a-8dca-4ff7-ab33-8b2bbc1fd70d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:49.191675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 852/1690] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:49.200523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e4f3a-8dca-4ff7-ab33-8b2bbc1fd70d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:49.215074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 839/1691] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:49.216007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25bb7d-4384-479b-93ed-551d8ec89e09 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:49.231216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e4f3a-8dca-4ff7-ab33-8b2bbc1fd70d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:49.246568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:49.247462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:49.247843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:49.248228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:49.251180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:49.251529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:49.253177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:49.256068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25bb7d-4384-479b-93ed-551d8ec89e09 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:49.275394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584982d9-c9bb-40d7-a2aa-fd59e2ae5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:49.277124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584982d9-c9bb-40d7-a2aa-fd59e2ae5be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:49.277721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584982d9-c9bb-40d7-a2aa-fd59e2ae5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:49.278010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584982d9-c9bb-40d7-a2aa-fd59e2ae5be9 admin admin] PATH_INFO: `/v3/projects/3b7c213e843b45ad9b688da360688ec7/users/e37f437c8d0b4ee6b102fb55f6787c5a/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:49.285694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584982d9-c9bb-40d7-a2aa-fd59e2ae5be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7c213e843b45ad9b688da360688ec7, user_id=e37f437c8d0b4ee6b102fb55f6787c5a, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:49.296197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 853/1692] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:49.299842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:49.305519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584982d9-c9bb-40d7-a2aa-fd59e2ae5be9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:49.306877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:49.344560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 840/1693] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:49 2022] PUT /identity/v3/projects/3b7c213e843b45ad9b688da360688ec7/users/e37f437c8d0b4ee6b102fb55f6787c5a/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:49.345789 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584982d9-c9bb-40d7-a2aa-fd59e2ae5be9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:49.457474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:49.487453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14b453-a1ed-4196-8a07-4ba727ae96a3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:49.502574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584982d9-c9bb-40d7-a2aa-fd59e2ae5be9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:49.518289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479b2f1-2c7c-4f9f-bcb1-66d7cf055fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:49.518927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b2f1-2c7c-4f9f-bcb1-66d7cf055fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:49.519206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b2f1-2c7c-4f9f-bcb1-66d7cf055fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:49.519479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b2f1-2c7c-4f9f-bcb1-66d7cf055fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:49.520123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479b2f1-2c7c-4f9f-bcb1-66d7cf055fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:49.522458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479b2f1-2c7c-4f9f-bcb1-66d7cf055fa4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:49.590676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 841/1694] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:49 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:49.592076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea4f31-1e3c-4f27-92af-1cd020806481 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:49.592368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea4f31-1e3c-4f27-92af-1cd020806481 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:49.592644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea4f31-1e3c-4f27-92af-1cd020806481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:49.639050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:49.639841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:49.640127 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:49.640401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:49.669938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9eea4f31-1e3c-4f27-92af-1cd020806481 None None] MFA Rules not processed for user `e37f437c8d0b4ee6b102fb55f6787c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:49.671180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9eea4f31-1e3c-4f27-92af-1cd020806481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:49.805958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:49.807749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:49.822638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 842/1695] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:49.823533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea4f31-1e3c-4f27-92af-1cd020806481 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:49.842049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 854/1696] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:49.877703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:49.883637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:49.907750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:49.939508 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1674bf9-886a-4382-8000-21990d112c33 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:49.965868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea4f31-1e3c-4f27-92af-1cd020806481 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:49.979838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6c2c-04a6-43b4-8164-d651bf700a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:49.980919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6c2c-04a6-43b4-8164-d651bf700a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:49.981135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6c2c-04a6-43b4-8164-d651bf700a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:49.981732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6c2c-04a6-43b4-8164-d651bf700a3b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:49.982494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d6c2c-04a6-43b4-8164-d651bf700a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:49.984417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d6c2c-04a6-43b4-8164-d651bf700a3b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:50.078444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 843/1697] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:49 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:50.079842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6c2c-04a6-43b4-8164-d651bf700a3b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:50.101417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6c2c-04a6-43b4-8164-d651bf700a3b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:50.116419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ccde7-b708-4a86-9b69-ff73ea9dfa44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:50.117059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ccde7-b708-4a86-9b69-ff73ea9dfa44 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.117336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ccde7-b708-4a86-9b69-ff73ea9dfa44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.117640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ccde7-b708-4a86-9b69-ff73ea9dfa44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.123668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:50.124298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.124580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.124859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.125523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:50.127159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:50.155400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ccde7-b708-4a86-9b69-ff73ea9dfa44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:50.163401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ccde7-b708-4a86-9b69-ff73ea9dfa44 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:50.176196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 844/1698] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:22:50.179074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:50.185942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:50.191903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 855/1699] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:50.194238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ccde7-b708-4a86-9b69-ff73ea9dfa44 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:50.230025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37d311-4b11-45e6-9cd5-9ceeaed82dd6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:50.231060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ccde7-b708-4a86-9b69-ff73ea9dfa44 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:50.251258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04673813-71ea-4e4c-8507-56646ad8c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:50.251884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04673813-71ea-4e4c-8507-56646ad8c643 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.252164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04673813-71ea-4e4c-8507-56646ad8c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.252436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04673813-71ea-4e4c-8507-56646ad8c643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.253082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04673813-71ea-4e4c-8507-56646ad8c643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:50.255992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:50.256674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.256955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.257233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] PATH_INFO: `/v3/users/10fb21d7001a4a5c96dda6a8295101d3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.258461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04673813-71ea-4e4c-8507-56646ad8c643 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:50.260157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10fb21d7001a4a5c96dda6a8295101d3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:50.262179 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:50.297688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 856/1700] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:50.300204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04673813-71ea-4e4c-8507-56646ad8c643 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:50.326738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04673813-71ea-4e4c-8507-56646ad8c643 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:50.342259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e070cfc-31a0-43d5-9090-85d912e9bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:50.342968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e070cfc-31a0-43d5-9090-85d912e9bccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.343251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e070cfc-31a0-43d5-9090-85d912e9bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.343521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e070cfc-31a0-43d5-9090-85d912e9bccf admin admin] PATH_INFO: `/v3/projects/0434bb8a4d534e13b1cf2a251d5f1563/users/51562fa33773473f883e62337837012e/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.380635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e070cfc-31a0-43d5-9090-85d912e9bccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0434bb8a4d534e13b1cf2a251d5f1563, user_id=51562fa33773473f883e62337837012e, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:50.384068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e070cfc-31a0-43d5-9090-85d912e9bccf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:50.397935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10fb21d7001a4a5c96dda6a8295101d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:50.398777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10fb21d7001a4a5c96dda6a8295101d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:50.422433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10fb21d7001a4a5c96dda6a8295101d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:50.425976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 857/1701] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:50 2022] PUT /identity/v3/projects/0434bb8a4d534e13b1cf2a251d5f1563/users/51562fa33773473f883e62337837012e/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:50.436572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf5e-0d22-45b5-a657-bfb422e8e238 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.436856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf5e-0d22-45b5-a657-bfb422e8e238 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.437123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf5e-0d22-45b5-a657-bfb422e8e238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.471305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10fb21d7001a4a5c96dda6a8295101d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:50.493301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10fb21d7001a4a5c96dda6a8295101d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:50.519851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 845/1702] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:50 2022] DELETE /identity/v3/users/10fb21d7001a4a5c96dda6a8295101d3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:50.520518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-634cbf5e-0d22-45b5-a657-bfb422e8e238 None None] MFA Rules not processed for user `51562fa33773473f883e62337837012e`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:50.521874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-634cbf5e-0d22-45b5-a657-bfb422e8e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:50.521998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:50.531656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:50.543363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:50.688389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 858/1703] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:22:50.692367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73c76-043f-4bcb-9271-efd1df077587 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.692367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73c76-043f-4bcb-9271-efd1df077587 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.692367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73c76-043f-4bcb-9271-efd1df077587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.745196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-efc73c76-043f-4bcb-9271-efd1df077587 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:50.747780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-efc73c76-043f-4bcb-9271-efd1df077587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:50.776428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 859/1704] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:50.779367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42296fb-520f-42ad-9e03-dbf559e17b64 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:50.783197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc73c76-043f-4bcb-9271-efd1df077587 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:50.786700 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-efc73c76-043f-4bcb-9271-efd1df077587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:50.809710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:50.810498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.810881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.811255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] PATH_INFO: `/v3/users/095421afae6444f9aadead8692657367` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.813086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=095421afae6444f9aadead8692657367)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:50.816792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:50.829635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc73c76-043f-4bcb-9271-efd1df077587 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:50.854253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22dce7-30fc-4f87-b4af-e2964408f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:50.855140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22dce7-30fc-4f87-b4af-e2964408f3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:50.855553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22dce7-30fc-4f87-b4af-e2964408f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:50.855921 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22dce7-30fc-4f87-b4af-e2964408f3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:50.856811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22dce7-30fc-4f87-b4af-e2964408f3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:50.858916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22dce7-30fc-4f87-b4af-e2964408f3c2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:50.905011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:50.948408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 860/1705] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:50 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:50.952917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22dce7-30fc-4f87-b4af-e2964408f3c2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:50.972163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095421afae6444f9aadead8692657367'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:50.972618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095421afae6444f9aadead8692657367'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:50.990393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095421afae6444f9aadead8692657367'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:51.023919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095421afae6444f9aadead8692657367'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:51.042309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095421afae6444f9aadead8692657367'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:51.057027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 846/1706] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:50 2022] DELETE /identity/v3/users/095421afae6444f9aadead8692657367 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:51.060156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:51.063182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:51.136817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22dce7-30fc-4f87-b4af-e2964408f3c2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:51.222317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4c012-27b4-422d-b84e-658104dd4b4f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:51.232947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:51.233920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:51.234211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:51.234509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:51.241376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:51.279029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c5bac-7679-476d-85f5-454aff4242cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:51.279765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c5bac-7679-476d-85f5-454aff4242cc admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:51.280044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c5bac-7679-476d-85f5-454aff4242cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:51.280396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c5bac-7679-476d-85f5-454aff4242cc admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:51.281324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c5bac-7679-476d-85f5-454aff4242cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:51.290377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c5bac-7679-476d-85f5-454aff4242cc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:51.331931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 861/1707] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:50 2022] POST /identity/v3/users => generated 294 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:51.333877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e94d6d-0639-4cb7-8ee5-7c922040b8b6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:51.334156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e94d6d-0639-4cb7-8ee5-7c922040b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:51.334471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e94d6d-0639-4cb7-8ee5-7c922040b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:51.369395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-27e94d6d-0639-4cb7-8ee5-7c922040b8b6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:51.371217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-27e94d6d-0639-4cb7-8ee5-7c922040b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:51.390947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 862/1708] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:51.391872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e94d6d-0639-4cb7-8ee5-7c922040b8b6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:51.403085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-27e94d6d-0639-4cb7-8ee5-7c922040b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:51.411816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:51.417390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:51.432269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e94d6d-0639-4cb7-8ee5-7c922040b8b6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:51.445786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 847/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:51.447472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f201f5-bf5e-4f78-9d73-d8ac646352a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:51.448225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f201f5-bf5e-4f78-9d73-d8ac646352a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:51.448435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f201f5-bf5e-4f78-9d73-d8ac646352a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:51.448639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f201f5-bf5e-4f78-9d73-d8ac646352a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:51.449293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f201f5-bf5e-4f78-9d73-d8ac646352a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:51.452929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f201f5-bf5e-4f78-9d73-d8ac646352a8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:51.466554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:51.486194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 863/1710] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:51.486967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:51.502599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bef6-682a-4076-b687-8894daf7d612 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:51.517474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81aa6-c513-4ef3-9e18-9fcf9e55a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:51.518350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81aa6-c513-4ef3-9e18-9fcf9e55a361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:51.518639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81aa6-c513-4ef3-9e18-9fcf9e55a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:51.518975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81aa6-c513-4ef3-9e18-9fcf9e55a361 admin admin] PATH_INFO: `/v3/projects/1e161219d5fc4b4e8224ff47ec87d27c/users/bd28afacb8664172bb7daf0a2178e8fd/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:51.569236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec81aa6-c513-4ef3-9e18-9fcf9e55a361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e161219d5fc4b4e8224ff47ec87d27c, user_id=bd28afacb8664172bb7daf0a2178e8fd, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:51.572049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec81aa6-c513-4ef3-9e18-9fcf9e55a361 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:51.606627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 848/1711] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:51 2022] PUT /identity/v3/projects/1e161219d5fc4b4e8224ff47ec87d27c/users/bd28afacb8664172bb7daf0a2178e8fd/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:51.608108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f201f5-bf5e-4f78-9d73-d8ac646352a8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:51.622625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f201f5-bf5e-4f78-9d73-d8ac646352a8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:51.641823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81aa6-c513-4ef3-9e18-9fcf9e55a361 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:51.741600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:51.813496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81aa6-c513-4ef3-9e18-9fcf9e55a361 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:51.834711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b52a2-eedd-4fa8-abc2-da98d36f1c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:51.838258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b52a2-eedd-4fa8-abc2-da98d36f1c6f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:51.838561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b52a2-eedd-4fa8-abc2-da98d36f1c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:51.839476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b52a2-eedd-4fa8-abc2-da98d36f1c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:51.846054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b6e6f-b851-435a-ace7-8893bb2bc800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:51.853573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b6e6f-b851-435a-ace7-8893bb2bc800 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:51.854102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b6e6f-b851-435a-ace7-8893bb2bc800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:51.858013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b6e6f-b851-435a-ace7-8893bb2bc800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:51.861414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b6e6f-b851-435a-ace7-8893bb2bc800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:51.866713 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b6e6f-b851-435a-ace7-8893bb2bc800 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:51.883643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b52a2-eedd-4fa8-abc2-da98d36f1c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:51.887484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b52a2-eedd-4fa8-abc2-da98d36f1c6f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:51.897376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 864/1712] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:51.901581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b6e6f-b851-435a-ace7-8893bb2bc800 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:51.915041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 849/1713] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:51.930731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b6e6f-b851-435a-ace7-8893bb2bc800 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:51.943176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64317d11-2df1-433c-a6e1-942fc83bfcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:51.943416 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64317d11-2df1-433c-a6e1-942fc83bfcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:51.943695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64317d11-2df1-433c-a6e1-942fc83bfcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:51.943971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64317d11-2df1-433c-a6e1-942fc83bfcf4 admin admin] PATH_INFO: `/v3/projects/1e161219d5fc4b4e8224ff47ec87d27c/users/bd28afacb8664172bb7daf0a2178e8fd/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:51.946364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64317d11-2df1-433c-a6e1-942fc83bfcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e161219d5fc4b4e8224ff47ec87d27c, user_id=bd28afacb8664172bb7daf0a2178e8fd, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:51.949708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64317d11-2df1-433c-a6e1-942fc83bfcf4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:51.981837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 865/1714] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:51 2022] PUT /identity/v3/projects/1e161219d5fc4b4e8224ff47ec87d27c/users/bd28afacb8664172bb7daf0a2178e8fd/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:22:51.994133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6a8da-6969-47cb-8d8d-ce64bfc59af5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:52.001528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6a8da-6969-47cb-8d8d-ce64bfc59af5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:52.003830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6a8da-6969-47cb-8d8d-ce64bfc59af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:52.011284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74898f7-9a35-46f1-b999-2a63d5f8a217 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:52.011441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74898f7-9a35-46f1-b999-2a63d5f8a217 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:52.011642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74898f7-9a35-46f1-b999-2a63d5f8a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:52.076761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f74898f7-9a35-46f1-b999-2a63d5f8a217 None None] MFA Rules not processed for user `db1b6c3b58304f179b77be28f0be2808`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:52.078806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f74898f7-9a35-46f1-b999-2a63d5f8a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:52.087911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3db6a8da-6969-47cb-8d8d-ce64bfc59af5 None None] MFA Rules not processed for user `bd28afacb8664172bb7daf0a2178e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:52.089268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3db6a8da-6969-47cb-8d8d-ce64bfc59af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:52.240456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 866/1715] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:22:52.250913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac2a4-e151-4fa6-a793-324bba1716b1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:52.251694 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac2a4-e151-4fa6-a793-324bba1716b1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:52.251988 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ac2a4-e151-4fa6-a793-324bba1716b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:52.266882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 850/1716] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:52.280053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6a8da-6969-47cb-8d8d-ce64bfc59af5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:52.282183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3db6a8da-6969-47cb-8d8d-ce64bfc59af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:52.290763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-667ac2a4-e151-4fa6-a793-324bba1716b1 None None] MFA Rules not processed for user `db1b6c3b58304f179b77be28f0be2808`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:52.295285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-667ac2a4-e151-4fa6-a793-324bba1716b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:52.315380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 867/1717] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:52.328290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ac2a4-e151-4fa6-a793-324bba1716b1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:52.342670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-667ac2a4-e151-4fa6-a793-324bba1716b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:52.429009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6a8da-6969-47cb-8d8d-ce64bfc59af5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:52.440359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcffff7-d6f7-4d79-a4c6-05023905abb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:52.441235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcffff7-d6f7-4d79-a4c6-05023905abb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:52.441565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcffff7-d6f7-4d79-a4c6-05023905abb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:52.441837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcffff7-d6f7-4d79-a4c6-05023905abb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:52.444445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ffcffff7-d6f7-4d79-a4c6-05023905abb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:52.453091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:52.500652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ac2a4-e151-4fa6-a793-324bba1716b1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:52.518687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:52.522382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:52.523062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:52.523519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:52.548036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:52.552352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:52.571389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcffff7-d6f7-4d79-a4c6-05023905abb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:52.572643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcffff7-d6f7-4d79-a4c6-05023905abb9 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:52.595643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 868/1718] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:52.603199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 851/1719] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:53.243069 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:53.244827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:53.352774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17070654-7870-4a29-aae9-ea8edc05726d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:53.353271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17070654-7870-4a29-aae9-ea8edc05726d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:53.353442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17070654-7870-4a29-aae9-ea8edc05726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:53.396730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:53.405554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-17070654-7870-4a29-aae9-ea8edc05726d None None] MFA Rules not processed for user `8f1e7d78567844e4a1fa2d969a4f4821`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:53.409007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-17070654-7870-4a29-aae9-ea8edc05726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:53.433144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4841e2-902b-444e-93b7-abd92b6a6d26 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:53.449303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:53.450752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:53.451036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:53.451303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] PATH_INFO: `/v3/projects/6609095be2bf4120b0177ba5925978b8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:53.452667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6609095be2bf4120b0177ba5925978b8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:53.455326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:53.566102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6609095be2bf4120b0177ba5925978b8', 'request_id': 'req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:53.605753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6609095be2bf4120b0177ba5925978b8', 'request_id': 'req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:53.633817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 852/1720] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:22:53.634842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17070654-7870-4a29-aae9-ea8edc05726d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:53.642885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-17070654-7870-4a29-aae9-ea8edc05726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:53.649434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6609095be2bf4120b0177ba5925978b8', 'request_id': 'req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:53.680600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17070654-7870-4a29-aae9-ea8edc05726d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:53.682343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] The token cache is being invalidate because project 6609095be2bf4120b0177ba5925978b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:53.682643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:53.683349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:53.689620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 869/1721] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:53 2022] DELETE /identity/v3/projects/6609095be2bf4120b0177ba5925978b8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:53.695991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:53.699897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:53.845687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3e186-e519-4a95-ab21-e8647df27f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:53.846500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e186-e519-4a95-ab21-e8647df27f7b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:53.847249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e186-e519-4a95-ab21-e8647df27f7b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:53.847530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e186-e519-4a95-ab21-e8647df27f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:53.851080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12c3e186-e519-4a95-ab21-e8647df27f7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:53.867825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47afeba-0339-41dd-ac72-e5e9f4f4a7dd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:53.886354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:53.887400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:53.888379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:53.888866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] PATH_INFO: `/v3/users/f1cfe30eaaec47f28a6778b4569ad9e9` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:53.890520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cfe30eaaec47f28a6778b4569ad9e9)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:53.893823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:53.931942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:53.995833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cfe30eaaec47f28a6778b4569ad9e9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:54.000878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cfe30eaaec47f28a6778b4569ad9e9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:54.002520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cfe30eaaec47f28a6778b4569ad9e9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:54.013095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3e186-e519-4a95-ab21-e8647df27f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:54.015978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3e186-e519-4a95-ab21-e8647df27f7b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:54.038939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cfe30eaaec47f28a6778b4569ad9e9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:54.039468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 853/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:54.050056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-288f83f3-9e45-4f40-96e2-e107d3bcb9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cfe30eaaec47f28a6778b4569ad9e9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:54.078450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 870/1723] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:53 2022] DELETE /identity/v3/users/f1cfe30eaaec47f28a6778b4569ad9e9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:54.589675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5c2ce-fde8-4ed9-a934-a23f723f8d30 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:54.590079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5c2ce-fde8-4ed9-a934-a23f723f8d30 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:54.590233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5c2ce-fde8-4ed9-a934-a23f723f8d30 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:54.592120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 854/1724] 10.222.0.15 () {54 vars in 912 bytes} [Thu Oct 6 12:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:22:54.599374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec685c-85df-4da4-a00e-e378c62a8f7b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:54.599894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec685c-85df-4da4-a00e-e378c62a8f7b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:54.599894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec685c-85df-4da4-a00e-e378c62a8f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:54.669215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c4ec685c-85df-4da4-a00e-e378c62a8f7b None None] MFA Rules not processed for user `c8bc6ac1df7f4bd383fded2b9a22ecf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:54.670492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c4ec685c-85df-4da4-a00e-e378c62a8f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:54.712411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5c2ce-fde8-4ed9-a934-a23f723f8d30 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:54.714687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f1a5c2ce-fde8-4ed9-a934-a23f723f8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:54.831055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:54.831598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 871/1725] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:54.871116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec685c-85df-4da4-a00e-e378c62a8f7b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:54.873871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c4ec685c-85df-4da4-a00e-e378c62a8f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:54.892919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5c2ce-fde8-4ed9-a934-a23f723f8d30 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:54.895948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec685c-85df-4da4-a00e-e378c62a8f7b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:54.905551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:54.906170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bffa6-a23f-4aa9-b601-d69fd7133f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:54.906612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:54.907066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:54.907487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] PATH_INFO: `/v3/projects/3e7e9afaaf58490c84df049f54decfa4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:54.908462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bffa6-a23f-4aa9-b601-d69fd7133f90 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:54.909258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7e9afaaf58490c84df049f54decfa4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:54.909680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bffa6-a23f-4aa9-b601-d69fd7133f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:54.910057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bffa6-a23f-4aa9-b601-d69fd7133f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:54.919296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:54.924608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bffa6-a23f-4aa9-b601-d69fd7133f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:54.928858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bffa6-a23f-4aa9-b601-d69fd7133f90 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:54.951046 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 872/1726] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:55.016351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7e9afaaf58490c84df049f54decfa4', 'request_id': 'req-8eabd50a-3438-45e1-95c9-d395298a531a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.030962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7e9afaaf58490c84df049f54decfa4', 'request_id': 'req-8eabd50a-3438-45e1-95c9-d395298a531a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.050893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7e9afaaf58490c84df049f54decfa4', 'request_id': 'req-8eabd50a-3438-45e1-95c9-d395298a531a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.088055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] The token cache is being invalidate because project 3e7e9afaaf58490c84df049f54decfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:55.088393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.089100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.094304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 855/1727] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:54 2022] DELETE /identity/v3/projects/3e7e9afaaf58490c84df049f54decfa4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:22:55.103622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bffa6-a23f-4aa9-b601-d69fd7133f90 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:55.133728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:55.135157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:55.136949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bffa6-a23f-4aa9-b601-d69fd7133f90 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:55.219148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:55.219965 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:55.220605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:55.220978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] PATH_INFO: `/v3/users/e37f437c8d0b4ee6b102fb55f6787c5a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:55.223806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37f437c8d0b4ee6b102fb55f6787c5a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:55.247140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:55.310584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabd50a-3438-45e1-95c9-d395298a531a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:55.328023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:55.328695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:55.329007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:55.329352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] PATH_INFO: `/v3/projects/422b43300c7042d592ea6fec8b70f5be` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:55.330575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=422b43300c7042d592ea6fec8b70f5be)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:55.332591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:55.363484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:55.439848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37f437c8d0b4ee6b102fb55f6787c5a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.441140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37f437c8d0b4ee6b102fb55f6787c5a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.442197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37f437c8d0b4ee6b102fb55f6787c5a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.460881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422b43300c7042d592ea6fec8b70f5be', 'request_id': 'req-a556677b-26ee-4166-9948-e9c6a0ffe5ce'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.483801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422b43300c7042d592ea6fec8b70f5be', 'request_id': 'req-a556677b-26ee-4166-9948-e9c6a0ffe5ce'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.492861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37f437c8d0b4ee6b102fb55f6787c5a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.498361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422b43300c7042d592ea6fec8b70f5be', 'request_id': 'req-a556677b-26ee-4166-9948-e9c6a0ffe5ce'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.521754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:55.525997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] The token cache is being invalidate because project 422b43300c7042d592ea6fec8b70f5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:55.526308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.534080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a556677b-26ee-4166-9948-e9c6a0ffe5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.536273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 856/1728] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:55 2022] DELETE /identity/v3/projects/422b43300c7042d592ea6fec8b70f5be => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:22:55.539459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-690f8968-ab23-4397-9bdf-2d258e3f108a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37f437c8d0b4ee6b102fb55f6787c5a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:55.541380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65f43-f3f0-4762-9ea6-0cbccc385af0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:55.541673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65f43-f3f0-4762-9ea6-0cbccc385af0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:55.542454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65f43-f3f0-4762-9ea6-0cbccc385af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:55.572520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 873/1729] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:22:55 2022] DELETE /identity/v3/users/e37f437c8d0b4ee6b102fb55f6787c5a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:55.604101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1dd65f43-f3f0-4762-9ea6-0cbccc385af0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:55.606155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1dd65f43-f3f0-4762-9ea6-0cbccc385af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:55.792801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 857/1730] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:22:55.802182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2e39-87a9-4031-bda7-55ab593f6de2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:55.802767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2e39-87a9-4031-bda7-55ab593f6de2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:55.804139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2e39-87a9-4031-bda7-55ab593f6de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:55.845273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e78d2e39-87a9-4031-bda7-55ab593f6de2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:55.846773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e78d2e39-87a9-4031-bda7-55ab593f6de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:55.896986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 874/1731] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:55.898078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd65f43-f3f0-4762-9ea6-0cbccc385af0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:55.914122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd65f43-f3f0-4762-9ea6-0cbccc385af0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:55.924327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:55.925324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:55.925835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:55.928026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:55.929875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:55.930600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:55.932719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:55.976940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d2e39-87a9-4031-bda7-55ab593f6de2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:55.985115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 858/1732] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:55.990617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d2e39-87a9-4031-bda7-55ab593f6de2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:55.997599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a0b9-60e1-4106-ac47-b9a247c71f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:55.998668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a0b9-60e1-4106-ac47-b9a247c71f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:55.999157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a0b9-60e1-4106-ac47-b9a247c71f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:55.999627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a0b9-60e1-4106-ac47-b9a247c71f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:56.000658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805a0b9-60e1-4106-ac47-b9a247c71f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:56.003473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805a0b9-60e1-4106-ac47-b9a247c71f23 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:56.058870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:56.072259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 875/1733] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:55 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:56.074287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a869-cb64-4a91-b555-5e79b2dedb5a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:56.210474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40980d68-c077-465e-94ea-ad38b3eefd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:56.212169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980d68-c077-465e-94ea-ad38b3eefd1b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:56.214067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980d68-c077-465e-94ea-ad38b3eefd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:56.214561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980d68-c077-465e-94ea-ad38b3eefd1b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:56.215369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40980d68-c077-465e-94ea-ad38b3eefd1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:56.221991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40980d68-c077-465e-94ea-ad38b3eefd1b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:56.282240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a0b9-60e1-4106-ac47-b9a247c71f23 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:56.283719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 859/1734] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:56 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:56.309583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a0b9-60e1-4106-ac47-b9a247c71f23 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:56.316582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616feeb6-2f6b-4dea-9647-1718f5d1211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:56.319092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616feeb6-2f6b-4dea-9647-1718f5d1211b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:56.319609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616feeb6-2f6b-4dea-9647-1718f5d1211b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:56.320137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616feeb6-2f6b-4dea-9647-1718f5d1211b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:56.322502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616feeb6-2f6b-4dea-9647-1718f5d1211b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:56.324986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616feeb6-2f6b-4dea-9647-1718f5d1211b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:56.346831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40980d68-c077-465e-94ea-ad38b3eefd1b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:56.358768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 876/1735] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:56.363922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40980d68-c077-465e-94ea-ad38b3eefd1b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:56.375335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8856a3-d4e8-4c73-bf2a-cee7a80e5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:56.377333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8856a3-d4e8-4c73-bf2a-cee7a80e5922 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:56.380066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8856a3-d4e8-4c73-bf2a-cee7a80e5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:56.380599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8856a3-d4e8-4c73-bf2a-cee7a80e5922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:56.384251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8856a3-d4e8-4c73-bf2a-cee7a80e5922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:56.387125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8856a3-d4e8-4c73-bf2a-cee7a80e5922 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:56.406620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616feeb6-2f6b-4dea-9647-1718f5d1211b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:56.408832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 860/1736] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:56.425422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616feeb6-2f6b-4dea-9647-1718f5d1211b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:56.431929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475954-08f5-491e-8286-409c0d157e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:56.432600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475954-08f5-491e-8286-409c0d157e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:56.432880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475954-08f5-491e-8286-409c0d157e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:56.433149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475954-08f5-491e-8286-409c0d157e89 admin admin] PATH_INFO: `/v3/projects/befe543f523d403cbfe74dbd288d3819/users/864fcf92bf124d7c8b38f4691b5fdd11/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:56.476621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b475954-08f5-491e-8286-409c0d157e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=befe543f523d403cbfe74dbd288d3819, user_id=864fcf92bf124d7c8b38f4691b5fdd11, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:56.479333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b475954-08f5-491e-8286-409c0d157e89 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:56.514753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 877/1737] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:56 2022] PUT /identity/v3/projects/befe543f523d403cbfe74dbd288d3819/users/864fcf92bf124d7c8b38f4691b5fdd11/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:56.519547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f22c-3769-437b-bbdb-c182179f9a9c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:56.520067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f22c-3769-437b-bbdb-c182179f9a9c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:56.520492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f22c-3769-437b-bbdb-c182179f9a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:56.561688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ced6f22c-3769-437b-bbdb-c182179f9a9c None None] MFA Rules not processed for user `864fcf92bf124d7c8b38f4691b5fdd11`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:56.563347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ced6f22c-3769-437b-bbdb-c182179f9a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:56.711519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:56.751853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 861/1738] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:56.756700 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475954-08f5-491e-8286-409c0d157e89 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:56.935292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f22c-3769-437b-bbdb-c182179f9a9c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:56.937019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ced6f22c-3769-437b-bbdb-c182179f9a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:56.978586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475954-08f5-491e-8286-409c0d157e89 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:57.028738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:57.034761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:57.040736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:57.041185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:57.042155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:57.045662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:57.140132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 878/1739] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:56 2022] POST /identity/v3/projects => generated 387 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:57.141262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:57.151344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:57.166418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f22c-3769-437b-bbdb-c182179f9a9c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:57.226843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:57.331933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05063746-d2fe-4ae9-997b-c56d422d0ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:57.332687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05063746-d2fe-4ae9-997b-c56d422d0ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:57.333212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05063746-d2fe-4ae9-997b-c56d422d0ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:57.333616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05063746-d2fe-4ae9-997b-c56d422d0ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:57.335114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac978a3-cd9c-4e1b-a13d-82f17b5584db admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:57.335825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-05063746-d2fe-4ae9-997b-c56d422d0ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:57.347586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:57.348416 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:57.348799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:57.349177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:57.353173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:57.396003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:57.397967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:57.422526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 879/1740] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:57.423537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:57.512729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05063746-d2fe-4ae9-997b-c56d422d0ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:57.514522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05063746-d2fe-4ae9-997b-c56d422d0ea4 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:57.528455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 862/1741] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:57.529935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d174aa-7af0-426a-85eb-7f31363c8294 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:57.530326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d174aa-7af0-426a-85eb-7f31363c8294 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:57.530741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d174aa-7af0-426a-85eb-7f31363c8294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:57.564736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-30d174aa-7af0-426a-85eb-7f31363c8294 None None] MFA Rules not processed for user `124d46b9c4d94ddfac10753c766b52b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:57.566168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-30d174aa-7af0-426a-85eb-7f31363c8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:57.620204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b7a09-f3c2-4b54-9f5c-a1ab683ebb7a service placement] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:57.633837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503209b-0650-4c52-a2e5-13014bc69280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:57.634576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503209b-0650-4c52-a2e5-13014bc69280 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:57.634978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503209b-0650-4c52-a2e5-13014bc69280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:57.635616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503209b-0650-4c52-a2e5-13014bc69280 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:57.636393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503209b-0650-4c52-a2e5-13014bc69280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:57.639169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503209b-0650-4c52-a2e5-13014bc69280 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:57.685449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:57.697636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 880/1742] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:57 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:57.703717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503209b-0650-4c52-a2e5-13014bc69280 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:57.731568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503209b-0650-4c52-a2e5-13014bc69280 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:57.746484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 863/1743] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:57.757157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59fa3d-09b5-4027-a73b-923e97c1dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:57.758034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fa3d-09b5-4027-a73b-923e97c1dfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:57.758418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fa3d-09b5-4027-a73b-923e97c1dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:57.758814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fa3d-09b5-4027-a73b-923e97c1dfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:57.759745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59fa3d-09b5-4027-a73b-923e97c1dfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:57.764194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d174aa-7af0-426a-85eb-7f31363c8294 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:57.766454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-30d174aa-7af0-426a-85eb-7f31363c8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:57.773817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59fa3d-09b5-4027-a73b-923e97c1dfc9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:57.833022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 881/1744] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:22:57.837403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59fa3d-09b5-4027-a73b-923e97c1dfc9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:57.864420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59fa3d-09b5-4027-a73b-923e97c1dfc9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:57.890753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:57.898429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:57.899942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:57.900382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:57.901556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:57.906616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:57.937179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 882/1745] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:57.954672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:57.973648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:57.988389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d174aa-7af0-426a-85eb-7f31363c8294 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:58.006917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56d34-34fe-4fa3-a952-e648e0c72db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:58.007870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56d34-34fe-4fa3-a952-e648e0c72db3 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.008259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56d34-34fe-4fa3-a952-e648e0c72db3 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.010560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56d34-34fe-4fa3-a952-e648e0c72db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.032088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39428-ce8e-4c5d-b685-5c0a45e83c42 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:58.032921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a56d34-34fe-4fa3-a952-e648e0c72db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:58.037348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a56d34-34fe-4fa3-a952-e648e0c72db3 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:58.056528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:58.057196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.057616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.057900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] PATH_INFO: `/v3/projects/3b7c213e843b45ad9b688da360688ec7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.062250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7c213e843b45ad9b688da360688ec7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:58.064241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:58.073137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 864/1746] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:58.074580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56d34-34fe-4fa3-a952-e648e0c72db3 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:58.106472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56d34-34fe-4fa3-a952-e648e0c72db3 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:58.116448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e2ccb-6364-4c68-a650-f5848e140663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:58.117243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2ccb-6364-4c68-a650-f5848e140663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.119133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2ccb-6364-4c68-a650-f5848e140663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.119133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2ccb-6364-4c68-a650-f5848e140663 admin admin] PATH_INFO: `/v3/projects/d5df6507238d4f8bbe3fdb7acbcd68dc/users/dbc19ed719d54c079893231fd0e86826/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.171426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2ccb-6364-4c68-a650-f5848e140663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5df6507238d4f8bbe3fdb7acbcd68dc, user_id=dbc19ed719d54c079893231fd0e86826, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:58.174332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2ccb-6364-4c68-a650-f5848e140663 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:58.208114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 865/1747] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:58 2022] PUT /identity/v3/projects/d5df6507238d4f8bbe3fdb7acbcd68dc/users/dbc19ed719d54c079893231fd0e86826/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:58.213997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb8072-6dbd-46a5-8e7e-0ad9bd637d57 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.214528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb8072-6dbd-46a5-8e7e-0ad9bd637d57 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.216192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb8072-6dbd-46a5-8e7e-0ad9bd637d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.259812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7c213e843b45ad9b688da360688ec7', 'request_id': 'req-045eb399-e50e-4b24-906e-689335f6a7ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:58.273218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-59eb8072-6dbd-46a5-8e7e-0ad9bd637d57 None None] MFA Rules not processed for user `8f1e7d78567844e4a1fa2d969a4f4821`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:58.277785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7c213e843b45ad9b688da360688ec7', 'request_id': 'req-045eb399-e50e-4b24-906e-689335f6a7ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:58.279333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-59eb8072-6dbd-46a5-8e7e-0ad9bd637d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:58.298302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7c213e843b45ad9b688da360688ec7', 'request_id': 'req-045eb399-e50e-4b24-906e-689335f6a7ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:58.326336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:58.335241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] The token cache is being invalidate because project 3b7c213e843b45ad9b688da360688ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:22:58.336625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:58.338732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-045eb399-e50e-4b24-906e-689335f6a7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:22:58.345425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 883/1748] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:22:57 2022] DELETE /identity/v3/projects/3b7c213e843b45ad9b688da360688ec7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:58.345670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66698428-ed28-48d1-aa76-b2b17979ff74 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.347236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66698428-ed28-48d1-aa76-b2b17979ff74 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.348135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66698428-ed28-48d1-aa76-b2b17979ff74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.425080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 866/1749] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:58.427330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce313-e488-40d0-914f-aa1d1b63c7e3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.430067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce313-e488-40d0-914f-aa1d1b63c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.430818 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce313-e488-40d0-914f-aa1d1b63c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.449650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-66698428-ed28-48d1-aa76-b2b17979ff74 None None] MFA Rules not processed for user `dbc19ed719d54c079893231fd0e86826`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:58.451412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-66698428-ed28-48d1-aa76-b2b17979ff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:58.478704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a67ce313-e488-40d0-914f-aa1d1b63c7e3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:58.480350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a67ce313-e488-40d0-914f-aa1d1b63c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:58.654094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:58.672636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 867/1750] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:58.680919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226d3e-01e4-47b4-b21b-44b1cdcc2918 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.681230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226d3e-01e4-47b4-b21b-44b1cdcc2918 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.681563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226d3e-01e4-47b4-b21b-44b1cdcc2918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.695864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 884/1751] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:58.698683 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66698428-ed28-48d1-aa76-b2b17979ff74 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:58.704115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-66698428-ed28-48d1-aa76-b2b17979ff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:58.740607 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-21226d3e-01e4-47b4-b21b-44b1cdcc2918 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:58.740856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66698428-ed28-48d1-aa76-b2b17979ff74 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:58.741881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-21226d3e-01e4-47b4-b21b-44b1cdcc2918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:58.753866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad166e7-6d7b-4b93-8961-347142e1582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:58.755180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad166e7-6d7b-4b93-8961-347142e1582e admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.755469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad166e7-6d7b-4b93-8961-347142e1582e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.755739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad166e7-6d7b-4b93-8961-347142e1582e admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.756400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad166e7-6d7b-4b93-8961-347142e1582e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:58.758384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad166e7-6d7b-4b93-8961-347142e1582e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:58.767053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 868/1752] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:58.772098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21226d3e-01e4-47b4-b21b-44b1cdcc2918 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:58.803741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21226d3e-01e4-47b4-b21b-44b1cdcc2918 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:58.825352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78856e-a901-4d1f-aa57-13dfbe99fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:58.826390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78856e-a901-4d1f-aa57-13dfbe99fff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.826783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78856e-a901-4d1f-aa57-13dfbe99fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.827164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78856e-a901-4d1f-aa57-13dfbe99fff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.828409 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78856e-a901-4d1f-aa57-13dfbe99fff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:22:58.829143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78856e-a901-4d1f-aa57-13dfbe99fff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:58.833748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78856e-a901-4d1f-aa57-13dfbe99fff4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:58.872059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 885/1753] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:58 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:58.881751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad166e7-6d7b-4b93-8961-347142e1582e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:58.897932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 869/1754] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:22:58.899304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ecfe9-865a-44d4-aade-24d7276b3378 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:58.899668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ecfe9-865a-44d4-aade-24d7276b3378 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:58.899954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ecfe9-865a-44d4-aade-24d7276b3378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:58.965430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ec1ecfe9-865a-44d4-aade-24d7276b3378 None None] MFA Rules not processed for user `f4a9da2cec0d420b800b99797166893f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:58.970837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec1ecfe9-865a-44d4-aade-24d7276b3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:59.086847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad166e7-6d7b-4b93-8961-347142e1582e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:59.116513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25616c8-0d95-47eb-82b2-869373c9f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:59.117735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25616c8-0d95-47eb-82b2-869373c9f95f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:59.118345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25616c8-0d95-47eb-82b2-869373c9f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:59.118819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25616c8-0d95-47eb-82b2-869373c9f95f admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:59.119736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25616c8-0d95-47eb-82b2-869373c9f95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:59.126935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25616c8-0d95-47eb-82b2-869373c9f95f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:59.191443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 886/1755] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:58 2022] POST /identity/v3/users => generated 300 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:59.197927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25616c8-0d95-47eb-82b2-869373c9f95f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:59.228807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25616c8-0d95-47eb-82b2-869373c9f95f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:59.234893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 870/1756] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:59.246998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ecfe9-865a-44d4-aade-24d7276b3378 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:59.254836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:59.257280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:59.257783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:59.259217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:59.263857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ecfe9-865a-44d4-aade-24d7276b3378 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:59.266869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:59.272034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156c803-8892-4c54-b7e5-92b84191e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:59.272669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156c803-8892-4c54-b7e5-92b84191e29d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:59.273617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156c803-8892-4c54-b7e5-92b84191e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:59.273905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156c803-8892-4c54-b7e5-92b84191e29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:59.274666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156c803-8892-4c54-b7e5-92b84191e29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:59.275360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:59.277960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156c803-8892-4c54-b7e5-92b84191e29d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:59.304724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 871/1757] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:22:59.306025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e12a59-833f-4a7f-b387-ea44489f39ab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:59.306328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e12a59-833f-4a7f-b387-ea44489f39ab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:59.306605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e12a59-833f-4a7f-b387-ea44489f39ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:59.342331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-52e12a59-833f-4a7f-b387-ea44489f39ab None None] MFA Rules not processed for user `f4a9da2cec0d420b800b99797166893f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:22:59.345327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-52e12a59-833f-4a7f-b387-ea44489f39ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:59.365269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 872/1758] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:22:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:22:59.366626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e12a59-833f-4a7f-b387-ea44489f39ab None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:59.390682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 887/1759] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:22:59 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:22:59.390682 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:59.390937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e12a59-833f-4a7f-b387-ea44489f39ab None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:59.402479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:22:59.539159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:59.612962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468fbb6-15d7-44d9-a5b8-062162860a47 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:22:59.645808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325bbdf-0c95-459b-a209-9e323b604000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:59.647123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bbdf-0c95-459b-a209-9e323b604000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:59.647835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bbdf-0c95-459b-a209-9e323b604000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:59.648287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bbdf-0c95-459b-a209-9e323b604000 admin admin] PATH_INFO: `/v3/projects/af70d58274d64bf892bc80aea43ab27a/users/8625c8617ba2466cb2f1619265f8209d/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:59.648980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d35c1e-13e1-46ec-a000-15dc283fc919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:22:59.653613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d35c1e-13e1-46ec-a000-15dc283fc919 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:22:59.654289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d35c1e-13e1-46ec-a000-15dc283fc919 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:22:59.654778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d35c1e-13e1-46ec-a000-15dc283fc919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:22:59.733211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325bbdf-0c95-459b-a209-9e323b604000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af70d58274d64bf892bc80aea43ab27a, user_id=8625c8617ba2466cb2f1619265f8209d, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:59.739510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325bbdf-0c95-459b-a209-9e323b604000 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:59.769142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d35c1e-13e1-46ec-a000-15dc283fc919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:22:59.776357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d35c1e-13e1-46ec-a000-15dc283fc919 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:22:59.782043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 873/1760] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:22:59 2022] PUT /identity/v3/projects/af70d58274d64bf892bc80aea43ab27a/users/8625c8617ba2466cb2f1619265f8209d/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:22:59.783455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325bbdf-0c95-459b-a209-9e323b604000 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:59.844597 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 888/1761] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:22:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:22:59.849415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d35c1e-13e1-46ec-a000-15dc283fc919 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:22:59.910265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:22:59.916703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d35c1e-13e1-46ec-a000-15dc283fc919 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:00.001457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325bbdf-0c95-459b-a209-9e323b604000 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:00.016385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1bbbd-2452-4489-a59a-167db028157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:00.029494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1bbbd-2452-4489-a59a-167db028157b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.031537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1bbbd-2452-4489-a59a-167db028157b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.031928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1bbbd-2452-4489-a59a-167db028157b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:00.032977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1bbbd-2452-4489-a59a-167db028157b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:00.048243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1bbbd-2452-4489-a59a-167db028157b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:00.115911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40d576-eecc-4305-aba0-d1b3b596e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:00.120517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d576-eecc-4305-aba0-d1b3b596e358 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.121286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d576-eecc-4305-aba0-d1b3b596e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.122936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d576-eecc-4305-aba0-d1b3b596e358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:00.123946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40d576-eecc-4305-aba0-d1b3b596e358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:00.128564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40d576-eecc-4305-aba0-d1b3b596e358 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:00.141114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 874/1762] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:22:59 2022] POST /identity/v3/users => generated 282 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:00.145506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1bbbd-2452-4489-a59a-167db028157b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:00.158421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 889/1763] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:00.159685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40d576-eecc-4305-aba0-d1b3b596e358 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:00.188211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1bbbd-2452-4489-a59a-167db028157b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:00.189287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40d576-eecc-4305-aba0-d1b3b596e358 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:00.202581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa451781-7393-4e60-ac02-2d17a15ac563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:00.203400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa451781-7393-4e60-ac02-2d17a15ac563 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.203859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa451781-7393-4e60-ac02-2d17a15ac563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.204334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa451781-7393-4e60-ac02-2d17a15ac563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:00.205250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa451781-7393-4e60-ac02-2d17a15ac563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:00.208073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa451781-7393-4e60-ac02-2d17a15ac563 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:00.220334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf71dfe-c46a-41cf-a8e4-586947818385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:00.228674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 875/1764] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:00.229022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf71dfe-c46a-41cf-a8e4-586947818385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.229568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf71dfe-c46a-41cf-a8e4-586947818385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.230486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa451781-7393-4e60-ac02-2d17a15ac563 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:00.231599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf71dfe-c46a-41cf-a8e4-586947818385 admin admin] PATH_INFO: `/v3/projects/af70d58274d64bf892bc80aea43ab27a/users/8625c8617ba2466cb2f1619265f8209d/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:00.241219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf71dfe-c46a-41cf-a8e4-586947818385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af70d58274d64bf892bc80aea43ab27a, user_id=8625c8617ba2466cb2f1619265f8209d, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:00.245455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa451781-7393-4e60-ac02-2d17a15ac563 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:00.251285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eca42-8f89-49ac-998b-62c07e8f9fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:00.252545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eca42-8f89-49ac-998b-62c07e8f9fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.253198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eca42-8f89-49ac-998b-62c07e8f9fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.253661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eca42-8f89-49ac-998b-62c07e8f9fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:00.255591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eca42-8f89-49ac-998b-62c07e8f9fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:00.258195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eca42-8f89-49ac-998b-62c07e8f9fd9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:00.261666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf71dfe-c46a-41cf-a8e4-586947818385 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:00.277931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 876/1765] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:00.281734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eca42-8f89-49ac-998b-62c07e8f9fd9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:00.305227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 890/1766] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:00 2022] PUT /identity/v3/projects/af70d58274d64bf892bc80aea43ab27a/users/8625c8617ba2466cb2f1619265f8209d/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:00.307790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eca42-8f89-49ac-998b-62c07e8f9fd9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:00.318054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ccfc7-8f41-4d4a-963a-8c9ee7903db4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.318381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ccfc7-8f41-4d4a-963a-8c9ee7903db4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.318659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ccfc7-8f41-4d4a-963a-8c9ee7903db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:00.443148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-162ccfc7-8f41-4d4a-963a-8c9ee7903db4 None None] MFA Rules not processed for user `8625c8617ba2466cb2f1619265f8209d`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:00.444422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-162ccfc7-8f41-4d4a-963a-8c9ee7903db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:00.481068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178e8c-e104-4656-b091-8ade0436f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:00.485522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178e8c-e104-4656-b091-8ade0436f464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.486081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178e8c-e104-4656-b091-8ade0436f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.486477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178e8c-e104-4656-b091-8ade0436f464 admin admin] PATH_INFO: `/v3/projects/d65d962ab28249c68c80fd621e686bf0/users/5f1ba8e290c24dc3abb31f3274d50925/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:00.545606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f178e8c-e104-4656-b091-8ade0436f464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65d962ab28249c68c80fd621e686bf0, user_id=5f1ba8e290c24dc3abb31f3274d50925, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:00.556811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f178e8c-e104-4656-b091-8ade0436f464 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:00.569188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:00.599363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 877/1767] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:00 2022] PUT /identity/v3/projects/d65d962ab28249c68c80fd621e686bf0/users/5f1ba8e290c24dc3abb31f3274d50925/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:00.617073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018adcd-5603-4d86-8578-1823a5cb8f42 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.618341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018adcd-5603-4d86-8578-1823a5cb8f42 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.618771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018adcd-5603-4d86-8578-1823a5cb8f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:00.687520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d018adcd-5603-4d86-8578-1823a5cb8f42 None None] MFA Rules not processed for user `5f1ba8e290c24dc3abb31f3274d50925`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:00.688961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d018adcd-5603-4d86-8578-1823a5cb8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:00.701505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 891/1768] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:00.713000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ccfc7-8f41-4d4a-963a-8c9ee7903db4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:00.716372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-162ccfc7-8f41-4d4a-963a-8c9ee7903db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:00.896167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ccfc7-8f41-4d4a-963a-8c9ee7903db4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:00.910869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 878/1769] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:00.912969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d668-c26d-488f-8ab0-958bdb782f29 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:00.913271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d668-c26d-488f-8ab0-958bdb782f29 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:00.913597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d668-c26d-488f-8ab0-958bdb782f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:01.000096 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:01.022888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e7c0d668-c26d-488f-8ab0-958bdb782f29 None None] MFA Rules not processed for user `57d8dd7c820144a082032626cb481df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:01.025149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e7c0d668-c26d-488f-8ab0-958bdb782f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:01.038791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0591c-786c-43b6-b7a8-ea574277b22b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:01.039725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0591c-786c-43b6-b7a8-ea574277b22b service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:01.040290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0591c-786c-43b6-b7a8-ea574277b22b service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:01.040712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0591c-786c-43b6-b7a8-ea574277b22b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:01.251977 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0591c-786c-43b6-b7a8-ea574277b22b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:01.254520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0591c-786c-43b6-b7a8-ea574277b22b service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:01.339977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 879/1770] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:01.346660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d668-c26d-488f-8ab0-958bdb782f29 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:01.367654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 892/1771] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:01.791748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d668-c26d-488f-8ab0-958bdb782f29 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:01.807075 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb62db-238c-4662-ba09-03ebdaaabbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:01.807712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb62db-238c-4662-ba09-03ebdaaabbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:01.807996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb62db-238c-4662-ba09-03ebdaaabbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:01.808272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb62db-238c-4662-ba09-03ebdaaabbb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:01.808926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb62db-238c-4662-ba09-03ebdaaabbb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:01.827310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb62db-238c-4662-ba09-03ebdaaabbb5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:01.956270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 880/1772] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:01 2022] POST /identity/v3/projects => generated 365 bytes in 615 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:01.962938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0591c-786c-43b6-b7a8-ea574277b22b service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:02.000183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0591c-786c-43b6-b7a8-ea574277b22b service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:02.001768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7582663-0ea1-4657-b019-ff23fd66a08f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:02.002061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7582663-0ea1-4657-b019-ff23fd66a08f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:02.002391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7582663-0ea1-4657-b019-ff23fd66a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:02.212681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:02.262107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2a78-d47e-4eef-aede-931cb93826c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:02.271092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2a78-d47e-4eef-aede-931cb93826c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:02.271488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2a78-d47e-4eef-aede-931cb93826c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:02.271770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2a78-d47e-4eef-aede-931cb93826c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:02.272449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c2a78-d47e-4eef-aede-931cb93826c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:02.282778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c2a78-d47e-4eef-aede-931cb93826c4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:02.302214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c7582663-0ea1-4657-b019-ff23fd66a08f None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:02.303468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7582663-0ea1-4657-b019-ff23fd66a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:02.348379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 893/1773] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:01 2022] POST /identity/v3/users => generated 289 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:02.349337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2a78-d47e-4eef-aede-931cb93826c4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:02.381077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2a78-d47e-4eef-aede-931cb93826c4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:02.399375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122906-338a-46d3-a94e-c9455bb6b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:02.403575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122906-338a-46d3-a94e-c9455bb6b3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:02.403884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122906-338a-46d3-a94e-c9455bb6b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:02.404166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122906-338a-46d3-a94e-c9455bb6b3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:02.407439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd122906-338a-46d3-a94e-c9455bb6b3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:02.418385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd122906-338a-46d3-a94e-c9455bb6b3a8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:02.454742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 894/1774] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:02.464883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122906-338a-46d3-a94e-c9455bb6b3a8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:02.522821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122906-338a-46d3-a94e-c9455bb6b3a8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:02.538273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c146e-3673-4754-8399-ff4c529fb537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:02.543737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c146e-3673-4754-8399-ff4c529fb537 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:02.544076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c146e-3673-4754-8399-ff4c529fb537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:02.544784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c146e-3673-4754-8399-ff4c529fb537 admin admin] PATH_INFO: `/v3/projects/527ae39c249f467da21a1c2115d6115c/users/a43350739fee469cb372487042fb0153/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:02.630200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c146e-3673-4754-8399-ff4c529fb537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527ae39c249f467da21a1c2115d6115c, user_id=a43350739fee469cb372487042fb0153, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:02.642706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c146e-3673-4754-8399-ff4c529fb537 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:02.659130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:02.668439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 881/1775] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 668 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:02.670651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9312a3-89b3-42e6-8727-495dc8d97c0a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:02.671877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9312a3-89b3-42e6-8727-495dc8d97c0a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:02.672164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9312a3-89b3-42e6-8727-495dc8d97c0a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:02.676452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 882/1776] 10.222.0.15 () {54 vars in 912 bytes} [Thu Oct 6 12:23:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:23:02.679000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9312a3-89b3-42e6-8727-495dc8d97c0a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:02.689954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5b9312a3-89b3-42e6-8727-495dc8d97c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:02.706522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 895/1777] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:02 2022] PUT /identity/v3/projects/527ae39c249f467da21a1c2115d6115c/users/a43350739fee469cb372487042fb0153/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:02.715992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e4be1-04df-4a17-bcef-bbf5f526ec33 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:02.716242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e4be1-04df-4a17-bcef-bbf5f526ec33 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:02.719813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e4be1-04df-4a17-bcef-bbf5f526ec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:02.854319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-375e4be1-04df-4a17-bcef-bbf5f526ec33 None None] MFA Rules not processed for user `c8bc6ac1df7f4bd383fded2b9a22ecf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:02.855887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-375e4be1-04df-4a17-bcef-bbf5f526ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:03.032356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9312a3-89b3-42e6-8727-495dc8d97c0a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:03.048431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2e8d9-7278-4507-9c4e-586ec160ac41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:03.053717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2e8d9-7278-4507-9c4e-586ec160ac41 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:03.054349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2e8d9-7278-4507-9c4e-586ec160ac41 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:03.054842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2e8d9-7278-4507-9c4e-586ec160ac41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:03.106742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 896/1778] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:03.108393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e4be1-04df-4a17-bcef-bbf5f526ec33 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:03.267482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2e8d9-7278-4507-9c4e-586ec160ac41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:03.269342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2e8d9-7278-4507-9c4e-586ec160ac41 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:03.291222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e4be1-04df-4a17-bcef-bbf5f526ec33 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:03.304793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:03.305501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:03.305843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:03.306120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:03.306778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:03.309956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:03.323245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 897/1780] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:03.323594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 883/1780] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:03.324149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:03.324983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2e8d9-7278-4507-9c4e-586ec160ac41 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:03.326161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:03.499529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:03.539146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2e8d9-7278-4507-9c4e-586ec160ac41 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:03.550063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:03.551471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:03.551948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:03.552406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:03.559086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:03.611737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac201e6-60d8-4726-90f5-5810e3a5bcfe admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:03.619851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae12bcf-6bd1-4b07-99c3-0439d4c65131 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:03.620688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae12bcf-6bd1-4b07-99c3-0439d4c65131 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:03.620920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae12bcf-6bd1-4b07-99c3-0439d4c65131 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:03.621356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae12bcf-6bd1-4b07-99c3-0439d4c65131 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:03.729900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:03.751196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:03.752656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:03.778897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 884/1781] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:03.786522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:03.790423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:03.803606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae12bcf-6bd1-4b07-99c3-0439d4c65131 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:03.808707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae12bcf-6bd1-4b07-99c3-0439d4c65131 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:03.838442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f7b0f-d1ee-4be0-a3ff-665cc45e4d9b service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:03.844071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 898/1782] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:23:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:23:03.847038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae12bcf-6bd1-4b07-99c3-0439d4c65131 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:03.854910 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e988897-11f6-4c23-af0a-c7a0683c9455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:03.855548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988897-11f6-4c23-af0a-c7a0683c9455 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:03.855828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988897-11f6-4c23-af0a-c7a0683c9455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:03.856104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988897-11f6-4c23-af0a-c7a0683c9455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:03.863319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae12bcf-6bd1-4b07-99c3-0439d4c65131 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:03.870620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8846b-ce88-46cf-b703-866b5a8f0851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:03.871667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8846b-ce88-46cf-b703-866b5a8f0851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:03.873262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8846b-ce88-46cf-b703-866b5a8f0851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:03.873827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8846b-ce88-46cf-b703-866b5a8f0851 admin admin] PATH_INFO: `/v3/projects/527ae39c249f467da21a1c2115d6115c/users/a43350739fee469cb372487042fb0153/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:03.877823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8846b-ce88-46cf-b703-866b5a8f0851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527ae39c249f467da21a1c2115d6115c, user_id=a43350739fee469cb372487042fb0153, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:03.886902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8846b-ce88-46cf-b703-866b5a8f0851 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:03.889695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e988897-11f6-4c23-af0a-c7a0683c9455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:03.891226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e988897-11f6-4c23-af0a-c7a0683c9455 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:03.947626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 885/1783] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:03.979560 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 899/1784] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:03 2022] PUT /identity/v3/projects/527ae39c249f467da21a1c2115d6115c/users/a43350739fee469cb372487042fb0153/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:03.989061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9494bd-af97-4221-974b-e2f72668ebbc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:03.989385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9494bd-af97-4221-974b-e2f72668ebbc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:03.989902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9494bd-af97-4221-974b-e2f72668ebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:04.047045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d23d6-ce86-479c-9a5a-50bd1806cc53 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:04.047446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d23d6-ce86-479c-9a5a-50bd1806cc53 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:04.047591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d23d6-ce86-479c-9a5a-50bd1806cc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:04.104100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8b9494bd-af97-4221-974b-e2f72668ebbc None None] MFA Rules not processed for user `a43350739fee469cb372487042fb0153`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:04.113811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b9494bd-af97-4221-974b-e2f72668ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:04.126918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6a8d23d6-ce86-479c-9a5a-50bd1806cc53 None None] MFA Rules not processed for user `124d46b9c4d94ddfac10753c766b52b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:04.131348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6a8d23d6-ce86-479c-9a5a-50bd1806cc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:04.291216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 886/1785] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:04.305780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9494bd-af97-4221-974b-e2f72668ebbc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:04.311314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b9494bd-af97-4221-974b-e2f72668ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:04.486145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 900/1786] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:04.612153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9494bd-af97-4221-974b-e2f72668ebbc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:04.654500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24c8b-6ee9-4f66-87f4-3c2b2f91a8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:04.655401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24c8b-6ee9-4f66-87f4-3c2b2f91a8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:04.655810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24c8b-6ee9-4f66-87f4-3c2b2f91a8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:04.656357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24c8b-6ee9-4f66-87f4-3c2b2f91a8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:04.697574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c24c8b-6ee9-4f66-87f4-3c2b2f91a8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:04.699990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c24c8b-6ee9-4f66-87f4-3c2b2f91a8a6 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:04.733836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 887/1787] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:05.103988 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d23d6-ce86-479c-9a5a-50bd1806cc53 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:05.122667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d23d6-ce86-479c-9a5a-50bd1806cc53 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:05.150290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d5fa2-a50b-4bcc-a18d-89c5706e0105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:05.151318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d5fa2-a50b-4bcc-a18d-89c5706e0105 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:05.152588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d5fa2-a50b-4bcc-a18d-89c5706e0105 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:05.153442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d5fa2-a50b-4bcc-a18d-89c5706e0105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:05.371789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d5fa2-a50b-4bcc-a18d-89c5706e0105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:05.375201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d5fa2-a50b-4bcc-a18d-89c5706e0105 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:05.394415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:05.427954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 901/1788] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:05.639719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6e5cf-ca7b-4f15-9994-d4301dbd1e7a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:05.640874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6e5cf-ca7b-4f15-9994-d4301dbd1e7a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:05.641341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6e5cf-ca7b-4f15-9994-d4301dbd1e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:05.745267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-12a6e5cf-ca7b-4f15-9994-d4301dbd1e7a None None] MFA Rules not processed for user `c8bc6ac1df7f4bd383fded2b9a22ecf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:05.746879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12a6e5cf-ca7b-4f15-9994-d4301dbd1e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:06.039597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 888/1789] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Oct 6 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:06.131718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d5fa2-a50b-4bcc-a18d-89c5706e0105 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:06.155167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d5fa2-a50b-4bcc-a18d-89c5706e0105 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:06.171797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a2388-8ed4-4f62-a13c-30deb486b2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:06.172971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a2388-8ed4-4f62-a13c-30deb486b2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:06.174669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a2388-8ed4-4f62-a13c-30deb486b2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:06.174962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a2388-8ed4-4f62-a13c-30deb486b2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:06.220213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a2388-8ed4-4f62-a13c-30deb486b2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:06.227800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a2388-8ed4-4f62-a13c-30deb486b2a8 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:06.287505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 902/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:06.491146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d72df-c852-499d-a622-726c661192d2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:06.491551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d72df-c852-499d-a622-726c661192d2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:06.491939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d72df-c852-499d-a622-726c661192d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:06.570406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bb8d72df-c852-499d-a622-726c661192d2 None None] MFA Rules not processed for user `f4a9da2cec0d420b800b99797166893f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:06.577085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bb8d72df-c852-499d-a622-726c661192d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:06.645235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:06.797857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 889/1791] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:10.897166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a2388-8ed4-4f62-a13c-30deb486b2a8 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:10.938674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a2388-8ed4-4f62-a13c-30deb486b2a8 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:10.959391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636661f-0a7d-4097-9e30-bfc2867ccfad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:10.960530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636661f-0a7d-4097-9e30-bfc2867ccfad service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:10.961217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636661f-0a7d-4097-9e30-bfc2867ccfad service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:10.965083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636661f-0a7d-4097-9e30-bfc2867ccfad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:11.100800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636661f-0a7d-4097-9e30-bfc2867ccfad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:11.105680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636661f-0a7d-4097-9e30-bfc2867ccfad service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:11.157231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 903/1792] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:13.669887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a462-ce87-4bf4-a5fd-9c5006c52184 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:13.670503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a462-ce87-4bf4-a5fd-9c5006c52184 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:13.670503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a462-ce87-4bf4-a5fd-9c5006c52184 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:13.672068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 890/1793] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:23:14.065424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f204-a971-47cb-9124-bbd9730aa192 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:14.066823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f204-a971-47cb-9124-bbd9730aa192 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:14.066823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f204-a971-47cb-9124-bbd9730aa192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:14.121709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-bcf1f204-a971-47cb-9124-bbd9730aa192 None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:14.123510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bcf1f204-a971-47cb-9124-bbd9730aa192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:14.335123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9a462-ce87-4bf4-a5fd-9c5006c52184 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:14.442565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 904/1794] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:14.531672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9a462-ce87-4bf4-a5fd-9c5006c52184 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:14.542278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:14.543221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:14.543657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:14.544084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] PATH_INFO: `/v3/users/5f1ba8e290c24dc3abb31f3274d50925` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:14.545507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1ba8e290c24dc3abb31f3274d50925)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:14.547654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:14.644155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1ba8e290c24dc3abb31f3274d50925'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:14.645274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1ba8e290c24dc3abb31f3274d50925'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:14.661685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1ba8e290c24dc3abb31f3274d50925'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:14.682028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1ba8e290c24dc3abb31f3274d50925'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:14.693460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1ba8e290c24dc3abb31f3274d50925'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:14.704000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 891/1795] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:14 2022] DELETE /identity/v3/users/5f1ba8e290c24dc3abb31f3274d50925 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:14.711873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ece-675c-4c92-b359-ce40c3635e6a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:14.712930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ece-675c-4c92-b359-ce40c3635e6a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:14.713609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ece-675c-4c92-b359-ce40c3635e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:14.824826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-09772ece-675c-4c92-b359-ce40c3635e6a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:14.830573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-09772ece-675c-4c92-b359-ce40c3635e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:15.146676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 905/1796] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:15.299217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:15.301058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:15.459628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:15.513579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09772ece-675c-4c92-b359-ce40c3635e6a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:15.515407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-09772ece-675c-4c92-b359-ce40c3635e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:15.516651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f63c61-8b3f-4ffe-ad8f-dd1c57736ccd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:15.538735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a28f7-ec1c-4d00-80c2-459bb50f2b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:15.539124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a28f7-ec1c-4d00-80c2-459bb50f2b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:15.539404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a28f7-ec1c-4d00-80c2-459bb50f2b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:15.539671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a28f7-ec1c-4d00-80c2-459bb50f2b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:15.554294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09772ece-675c-4c92-b359-ce40c3635e6a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:15.562462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a28f7-ec1c-4d00-80c2-459bb50f2b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:15.563962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a28f7-ec1c-4d00-80c2-459bb50f2b37 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:15.573171 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:15.574683 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:15.575066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:15.575442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] PATH_INFO: `/v3/users/864fcf92bf124d7c8b38f4691b5fdd11` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:15.579958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=864fcf92bf124d7c8b38f4691b5fdd11)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:15.581622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:15.611037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:15.636100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 892/1797] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:15.710177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864fcf92bf124d7c8b38f4691b5fdd11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:15.713217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864fcf92bf124d7c8b38f4691b5fdd11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:15.714236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864fcf92bf124d7c8b38f4691b5fdd11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:15.752273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864fcf92bf124d7c8b38f4691b5fdd11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:15.781092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864fcf92bf124d7c8b38f4691b5fdd11'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:15.857467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 906/1798] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:15 2022] DELETE /identity/v3/users/864fcf92bf124d7c8b38f4691b5fdd11 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:15.859132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55265-ca88-463c-9fa2-0fbdb3141642 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:15.860166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55265-ca88-463c-9fa2-0fbdb3141642 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:15.860978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55265-ca88-463c-9fa2-0fbdb3141642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:15.934696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6ca55265-ca88-463c-9fa2-0fbdb3141642 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:15.936275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ca55265-ca88-463c-9fa2-0fbdb3141642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:15.946221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:15.947681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:16.055093 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 893/1799] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:16.176038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aefd28-59ea-4922-8413-7601283227eb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:16.200419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c2263-ea4c-4cc9-adf6-2ddefca7a575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:16.201514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2263-ea4c-4cc9-adf6-2ddefca7a575 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:16.201833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2263-ea4c-4cc9-adf6-2ddefca7a575 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:16.202112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2263-ea4c-4cc9-adf6-2ddefca7a575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:16.204375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-450c2263-ea4c-4cc9-adf6-2ddefca7a575 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:16.233329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f867f-b45f-4d30-a5ff-f7c6a4e5d444 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:16.233893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f867f-b45f-4d30-a5ff-f7c6a4e5d444 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:16.234338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f867f-b45f-4d30-a5ff-f7c6a4e5d444 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:16.236326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 894/1800] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:23:16.244957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c2263-ea4c-4cc9-adf6-2ddefca7a575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:16.246902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c2263-ea4c-4cc9-adf6-2ddefca7a575 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:16.282787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 907/1801] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:23:16.655280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f867f-b45f-4d30-a5ff-f7c6a4e5d444 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:16.657163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-364f867f-b45f-4d30-a5ff-f7c6a4e5d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:16.708636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f867f-b45f-4d30-a5ff-f7c6a4e5d444 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:16.720270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:16.720940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:16.725374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:16.725767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] PATH_INFO: `/v3/users/51562fa33773473f883e62337837012e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:16.730817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51562fa33773473f883e62337837012e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:16.734767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:16.763141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496824-3e31-4826-8ca6-cfafb31caef0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:16.763791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496824-3e31-4826-8ca6-cfafb31caef0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:16.764203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496824-3e31-4826-8ca6-cfafb31caef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:16.862736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-14496824-3e31-4826-8ca6-cfafb31caef0 None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:16.864300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-14496824-3e31-4826-8ca6-cfafb31caef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:16.871126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51562fa33773473f883e62337837012e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:16.871854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51562fa33773473f883e62337837012e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:16.890771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51562fa33773473f883e62337837012e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:16.903180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 908/1802] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:16.904120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496824-3e31-4826-8ca6-cfafb31caef0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:16.913574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-14496824-3e31-4826-8ca6-cfafb31caef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:16.953241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51562fa33773473f883e62337837012e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:16.993222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aa0af691-8889-4499-9c99-d6f1c25e008a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51562fa33773473f883e62337837012e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:17.014917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 895/1803] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:16 2022] DELETE /identity/v3/users/51562fa33773473f883e62337837012e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:17.016350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4a9a9-cb25-41f7-a9f6-36134c0eddc2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:17.016645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4a9a9-cb25-41f7-a9f6-36134c0eddc2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:17.016929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4a9a9-cb25-41f7-a9f6-36134c0eddc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:17.088245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496824-3e31-4826-8ca6-cfafb31caef0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:17.103594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6aa4a9a9-cb25-41f7-a9f6-36134c0eddc2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:17.116187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6aa4a9a9-cb25-41f7-a9f6-36134c0eddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:17.219018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:17.262708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:17.292368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 896/1804] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:17.353677 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:17.354967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:17.356242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:17.356799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:17.365920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:17.387871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:17.390070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:17.413303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 909/1805] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:17.502278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4a9a9-cb25-41f7-a9f6-36134c0eddc2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:17.506321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6aa4a9a9-cb25-41f7-a9f6-36134c0eddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:17.522985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4a9a9-cb25-41f7-a9f6-36134c0eddc2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:17.537323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ef336-8e6c-46fa-a3bb-22ed42d9a393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:17.537968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef336-8e6c-46fa-a3bb-22ed42d9a393 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:17.539013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef336-8e6c-46fa-a3bb-22ed42d9a393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:17.539013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef336-8e6c-46fa-a3bb-22ed42d9a393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:17.563484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef336-8e6c-46fa-a3bb-22ed42d9a393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:17.565333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef336-8e6c-46fa-a3bb-22ed42d9a393 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:17.583328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 897/1806] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:17.762676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:17.764582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:18.084569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59efed-ac0f-4cfc-804f-537687a88d7a service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:18.105139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:18.106068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:18.106353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:18.106630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:18.133904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:18.134749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1bad7-70d0-4d82-90f0-c69e09aa00ca None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:18.135542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:18.136374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1bad7-70d0-4d82-90f0-c69e09aa00ca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:18.136666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1bad7-70d0-4d82-90f0-c69e09aa00ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:18.157184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 910/1807] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:18.199835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4ba1bad7-70d0-4d82-90f0-c69e09aa00ca None None] MFA Rules not processed for user `57d8dd7c820144a082032626cb481df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:18.204297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4ba1bad7-70d0-4d82-90f0-c69e09aa00ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:18.410853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 898/1808] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:19.260094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:19.261702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:19.278381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1bad7-70d0-4d82-90f0-c69e09aa00ca None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:19.280990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4ba1bad7-70d0-4d82-90f0-c69e09aa00ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:19.286757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c311-2f08-4f98-af5b-de715d707084 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:19.305730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:19.306746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:19.312391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:19.312794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] PATH_INFO: `/v3/projects/d65d962ab28249c68c80fd621e686bf0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:19.313056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1bad7-70d0-4d82-90f0-c69e09aa00ca None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:19.315141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65d962ab28249c68c80fd621e686bf0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:19.317301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:19.330837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:19.346139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:19.349444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:19.350029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] PATH_INFO: `/v3/projects/befe543f523d403cbfe74dbd288d3819` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:19.351723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=befe543f523d403cbfe74dbd288d3819)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:19.354066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:19.445580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65d962ab28249c68c80fd621e686bf0', 'request_id': 'req-dcc5a999-9591-4f7b-89da-6268a37d8931'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.466069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befe543f523d403cbfe74dbd288d3819', 'request_id': 'req-b5955b69-8738-455b-b32d-ba55ce1cfa93'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.476544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65d962ab28249c68c80fd621e686bf0', 'request_id': 'req-dcc5a999-9591-4f7b-89da-6268a37d8931'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.505092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befe543f523d403cbfe74dbd288d3819', 'request_id': 'req-b5955b69-8738-455b-b32d-ba55ce1cfa93'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.515108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65d962ab28249c68c80fd621e686bf0', 'request_id': 'req-dcc5a999-9591-4f7b-89da-6268a37d8931'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.522573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befe543f523d403cbfe74dbd288d3819', 'request_id': 'req-b5955b69-8738-455b-b32d-ba55ce1cfa93'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.544763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] The token cache is being invalidate because project d65d962ab28249c68c80fd621e686bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:19.546579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.549077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.552814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 911/1809] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:19 2022] DELETE /identity/v3/projects/d65d962ab28249c68c80fd621e686bf0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:19.554569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:19.557831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] The token cache is being invalidate because project befe543f523d403cbfe74dbd288d3819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:19.558785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:19.559344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.563117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.568060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 899/1810] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:19 2022] DELETE /identity/v3/projects/befe543f523d403cbfe74dbd288d3819 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:19.569241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:19.573305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:19.625582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:19.688734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5a999-9591-4f7b-89da-6268a37d8931 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:19.717850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5955b69-8738-455b-b32d-ba55ce1cfa93 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:19.728658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:19.729315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:19.730242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:19.730398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] PATH_INFO: `/v3/users/a43350739fee469cb372487042fb0153` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:19.732075 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43350739fee469cb372487042fb0153)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:19.734077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:19.780392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:19.818928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:19.819809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:19.820104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:19.820494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] PATH_INFO: `/v3/projects/0434bb8a4d534e13b1cf2a251d5f1563` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:19.822340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0434bb8a4d534e13b1cf2a251d5f1563)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:19.824718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:19.903116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43350739fee469cb372487042fb0153'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.903830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43350739fee469cb372487042fb0153'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.921299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43350739fee469cb372487042fb0153'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.922116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0434bb8a4d534e13b1cf2a251d5f1563', 'request_id': 'req-174e72b9-304f-4656-a6ee-22e113832742'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.945590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0434bb8a4d534e13b1cf2a251d5f1563', 'request_id': 'req-174e72b9-304f-4656-a6ee-22e113832742'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.959276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43350739fee469cb372487042fb0153'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.964106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0434bb8a4d534e13b1cf2a251d5f1563', 'request_id': 'req-174e72b9-304f-4656-a6ee-22e113832742'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.980035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43350739fee469cb372487042fb0153'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.984202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] The token cache is being invalidate because project 0434bb8a4d534e13b1cf2a251d5f1563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:19.984819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.986105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:19.989335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 912/1811] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:19 2022] DELETE /identity/v3/projects/0434bb8a4d534e13b1cf2a251d5f1563 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:19.990716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:20.001066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:20.007474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 900/1812] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:19 2022] DELETE /identity/v3/users/a43350739fee469cb372487042fb0153 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:20.013901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:20.018182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:20.099207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e72b9-304f-4656-a6ee-22e113832742 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:20.122400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:20.179885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc9dc-ce7b-4c8b-985a-36702483a73b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:20.191899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:20.194082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:20.195211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:20.195491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] PATH_INFO: `/v3/users/bd28afacb8664172bb7daf0a2178e8fd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:20.201184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd28afacb8664172bb7daf0a2178e8fd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:20.203253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:20.254660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:20.255600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:20.255961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:20.256462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] PATH_INFO: `/v3/users/dbc19ed719d54c079893231fd0e86826` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:20.259420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc19ed719d54c079893231fd0e86826)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:20.262443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:20.319189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd28afacb8664172bb7daf0a2178e8fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.324489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd28afacb8664172bb7daf0a2178e8fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.348492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd28afacb8664172bb7daf0a2178e8fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.389465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd28afacb8664172bb7daf0a2178e8fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.404146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc19ed719d54c079893231fd0e86826'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.404956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc19ed719d54c079893231fd0e86826'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.405695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc19ed719d54c079893231fd0e86826'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.408891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd28afacb8664172bb7daf0a2178e8fd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.422767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 901/1813] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:20 2022] DELETE /identity/v3/users/bd28afacb8664172bb7daf0a2178e8fd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:20.435555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc19ed719d54c079893231fd0e86826'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.448117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc19ed719d54c079893231fd0e86826'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:20.473566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 913/1814] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:19 2022] DELETE /identity/v3/users/dbc19ed719d54c079893231fd0e86826 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:21.593935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:21.595490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:21.612943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:21.675568 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f849a-e93c-4e22-8e59-e30e76d647b9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:21.736421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:21.737116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:21.738924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:21.739215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] PATH_INFO: `/v3/projects/1e161219d5fc4b4e8224ff47ec87d27c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:21.740488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e161219d5fc4b4e8224ff47ec87d27c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:21.742473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:21.799158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e161219d5fc4b4e8224ff47ec87d27c', 'request_id': 'req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:21.815829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e161219d5fc4b4e8224ff47ec87d27c', 'request_id': 'req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:21.827528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e161219d5fc4b4e8224ff47ec87d27c', 'request_id': 'req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:21.841301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] The token cache is being invalidate because project 1e161219d5fc4b4e8224ff47ec87d27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:21.841860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:21.842544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4dedec4-ae1d-4a1c-851c-bbbe5681b5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:21.844331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 902/1815] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:21 2022] DELETE /identity/v3/projects/1e161219d5fc4b4e8224ff47ec87d27c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:21.849069 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:21.850645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:21.856448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543347-f6af-42eb-b6a6-9734e84d611a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:21.856808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543347-f6af-42eb-b6a6-9734e84d611a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:21.857151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543347-f6af-42eb-b6a6-9734e84d611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:21.868772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70967c9f-c232-46ef-875e-4b2455b5879f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:21.887577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fc543347-f6af-42eb-b6a6-9734e84d611a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:21.888809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc543347-f6af-42eb-b6a6-9734e84d611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:21.990935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:21.992936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:21.993803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:21.994153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:21.994492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] PATH_INFO: `/v3/projects/527ae39c249f467da21a1c2115d6115c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:21.995710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527ae39c249f467da21a1c2115d6115c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:21.997978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.014089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 903/1816] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:22.015062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc543347-f6af-42eb-b6a6-9734e84d611a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.021861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc543347-f6af-42eb-b6a6-9734e84d611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:22.036964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc543347-f6af-42eb-b6a6-9734e84d611a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.043523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.044257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.044796 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.045060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] PATH_INFO: `/v3/projects/d5df6507238d4f8bbe3fdb7acbcd68dc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.046560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5df6507238d4f8bbe3fdb7acbcd68dc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.049177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.059628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:22.069096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527ae39c249f467da21a1c2115d6115c', 'request_id': 'req-cc112dfe-9b5b-48a0-a335-633eb81838d2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.078013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527ae39c249f467da21a1c2115d6115c', 'request_id': 'req-cc112dfe-9b5b-48a0-a335-633eb81838d2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.086306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527ae39c249f467da21a1c2115d6115c', 'request_id': 'req-cc112dfe-9b5b-48a0-a335-633eb81838d2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.106577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] The token cache is being invalidate because project 527ae39c249f467da21a1c2115d6115c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:22.107080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.107814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc112dfe-9b5b-48a0-a335-633eb81838d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.109450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 914/1817] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:21 2022] DELETE /identity/v3/projects/527ae39c249f467da21a1c2115d6115c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:22.110928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503091a-9e1d-4f0f-8727-cb9f1686505f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.111273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503091a-9e1d-4f0f-8727-cb9f1686505f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.111614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503091a-9e1d-4f0f-8727-cb9f1686505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.124527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5df6507238d4f8bbe3fdb7acbcd68dc', 'request_id': 'req-45d1982e-74f4-47f9-8474-5ed7d4a514ed'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.134928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5df6507238d4f8bbe3fdb7acbcd68dc', 'request_id': 'req-45d1982e-74f4-47f9-8474-5ed7d4a514ed'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.135176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1503091a-9e1d-4f0f-8727-cb9f1686505f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:22.136585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1503091a-9e1d-4f0f-8727-cb9f1686505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:22.144355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5df6507238d4f8bbe3fdb7acbcd68dc', 'request_id': 'req-45d1982e-74f4-47f9-8474-5ed7d4a514ed'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.157007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] The token cache is being invalidate because project d5df6507238d4f8bbe3fdb7acbcd68dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:22.157390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.158145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-45d1982e-74f4-47f9-8474-5ed7d4a514ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.160453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 904/1818] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:22 2022] DELETE /identity/v3/projects/d5df6507238d4f8bbe3fdb7acbcd68dc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:22.161814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087b16-3077-436d-b079-90dfcc72b2dc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.162169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087b16-3077-436d-b079-90dfcc72b2dc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.162513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087b16-3077-436d-b079-90dfcc72b2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.182814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4c087b16-3077-436d-b079-90dfcc72b2dc None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:22.184156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4c087b16-3077-436d-b079-90dfcc72b2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:22.207295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 915/1819] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:22.210504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503091a-9e1d-4f0f-8727-cb9f1686505f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.212046 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1503091a-9e1d-4f0f-8727-cb9f1686505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:22.226545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503091a-9e1d-4f0f-8727-cb9f1686505f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.231637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.232418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.232697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.233081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] PATH_INFO: `/v3/users/8625c8617ba2466cb2f1619265f8209d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.234678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8625c8617ba2466cb2f1619265f8209d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.236572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.256069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 905/1820] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:22.262527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087b16-3077-436d-b079-90dfcc72b2dc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.281197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087b16-3077-436d-b079-90dfcc72b2dc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.302143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe220c-b9fb-418f-81c2-85f023a2cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.302803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe220c-b9fb-418f-81c2-85f023a2cf5a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.303115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe220c-b9fb-418f-81c2-85f023a2cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.303392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe220c-b9fb-418f-81c2-85f023a2cf5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.304156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe220c-b9fb-418f-81c2-85f023a2cf5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:22.304391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe220c-b9fb-418f-81c2-85f023a2cf5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.306060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe220c-b9fb-418f-81c2-85f023a2cf5a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.307247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8625c8617ba2466cb2f1619265f8209d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.308283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8625c8617ba2466cb2f1619265f8209d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.308984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8625c8617ba2466cb2f1619265f8209d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.325431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 906/1821] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:23:22.325431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7648814-e3aa-43ac-92a2-46c1a4d54dd6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.325431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7648814-e3aa-43ac-92a2-46c1a4d54dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.325431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7648814-e3aa-43ac-92a2-46c1a4d54dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.327860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8625c8617ba2466cb2f1619265f8209d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.337778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8625c8617ba2466cb2f1619265f8209d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.345368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b7648814-e3aa-43ac-92a2-46c1a4d54dd6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:22.347231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b7648814-e3aa-43ac-92a2-46c1a4d54dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:22.353362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 916/1822] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:22 2022] DELETE /identity/v3/users/8625c8617ba2466cb2f1619265f8209d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:22.354585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.356001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:22.359883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 907/1823] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:22.364571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7648814-e3aa-43ac-92a2-46c1a4d54dd6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.374318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7648814-e3aa-43ac-92a2-46c1a4d54dd6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.447227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:22.464144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.465715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.466785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.467290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.468710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:22.469700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.472019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.480917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:22.486285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 908/1824] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:23:22.491183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.503334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c34dfd-5232-48d2-9265-d2f7d539fcb8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.509168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d213-b4fc-4aac-96bd-eb24e02aaa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.509976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d213-b4fc-4aac-96bd-eb24e02aaa27 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.510335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d213-b4fc-4aac-96bd-eb24e02aaa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.510829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d213-b4fc-4aac-96bd-eb24e02aaa27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.511572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d213-b4fc-4aac-96bd-eb24e02aaa27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.514304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d213-b4fc-4aac-96bd-eb24e02aaa27 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.515826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015b2f0-1222-41a2-92c0-c12aa77c0b84 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.522557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e250f3b-b85b-4b8a-abf4-7dbadc441153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.523491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250f3b-b85b-4b8a-abf4-7dbadc441153 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.523906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250f3b-b85b-4b8a-abf4-7dbadc441153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.524247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250f3b-b85b-4b8a-abf4-7dbadc441153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.525011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e250f3b-b85b-4b8a-abf4-7dbadc441153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.527665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e250f3b-b85b-4b8a-abf4-7dbadc441153 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.550790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 909/1825] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:22 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:23:22.555313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d213-b4fc-4aac-96bd-eb24e02aaa27 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.566744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 917/1826] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:22 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:22.567613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e250f3b-b85b-4b8a-abf4-7dbadc441153 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.638636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d213-b4fc-4aac-96bd-eb24e02aaa27 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.664697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e250f3b-b85b-4b8a-abf4-7dbadc441153 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.669898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd00d6-6a4f-497b-8b71-5cab5508ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.670593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd00d6-6a4f-497b-8b71-5cab5508ce7f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.670928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd00d6-6a4f-497b-8b71-5cab5508ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.671268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd00d6-6a4f-497b-8b71-5cab5508ce7f admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.671998 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd00d6-6a4f-497b-8b71-5cab5508ce7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.674086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd00d6-6a4f-497b-8b71-5cab5508ce7f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.700678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 918/1827] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:22 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:22.704685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd00d6-6a4f-497b-8b71-5cab5508ce7f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.706805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e808a2e-0334-4f9f-9558-d7907233e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.707461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e808a2e-0334-4f9f-9558-d7907233e611 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.707741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e808a2e-0334-4f9f-9558-d7907233e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.708184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e808a2e-0334-4f9f-9558-d7907233e611 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.708829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e808a2e-0334-4f9f-9558-d7907233e611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.710999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e808a2e-0334-4f9f-9558-d7907233e611 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.715763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd00d6-6a4f-497b-8b71-5cab5508ce7f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.721518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d08bc8-cd45-470f-aca1-e4453c9ec683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.722217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d08bc8-cd45-470f-aca1-e4453c9ec683 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.722502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d08bc8-cd45-470f-aca1-e4453c9ec683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.722790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d08bc8-cd45-470f-aca1-e4453c9ec683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.723534 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d08bc8-cd45-470f-aca1-e4453c9ec683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.725284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d08bc8-cd45-470f-aca1-e4453c9ec683 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.736691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 919/1828] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:22.741621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 910/1829] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:22 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:22.743495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e808a2e-0334-4f9f-9558-d7907233e611 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.743723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d08bc8-cd45-470f-aca1-e4453c9ec683 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.760008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d08bc8-cd45-470f-aca1-e4453c9ec683 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.760885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e808a2e-0334-4f9f-9558-d7907233e611 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.765623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.766644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.766756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf923b04-7dca-460c-8678-5ac2a778d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.767060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.767325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf923b04-7dca-460c-8678-5ac2a778d27a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.767444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.767613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf923b04-7dca-460c-8678-5ac2a778d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.767894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf923b04-7dca-460c-8678-5ac2a778d27a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.768131 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.769816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf923b04-7dca-460c-8678-5ac2a778d27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.771720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.775452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf923b04-7dca-460c-8678-5ac2a778d27a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.786251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 920/1830] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:22.786251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.786251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:22.790152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 911/1831] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:22.791116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf923b04-7dca-460c-8678-5ac2a778d27a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.799730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a9b7-aa13-4433-9a55-baec7e265e8e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.803706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf923b04-7dca-460c-8678-5ac2a778d27a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.809883 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d264496-62e8-4db0-b0dc-412c6a775769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.810529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d264496-62e8-4db0-b0dc-412c6a775769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.811331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d264496-62e8-4db0-b0dc-412c6a775769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.811331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d264496-62e8-4db0-b0dc-412c6a775769 admin admin] PATH_INFO: `/v3/projects/1ca00e50577146a8bffa69cb0ac98687/users/524552d1bd904565957bcb3431c7123e/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.818982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.819807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.820174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.820396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] PATH_INFO: `/v3/projects/af70d58274d64bf892bc80aea43ab27a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.821762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af70d58274d64bf892bc80aea43ab27a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.824532 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.832151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d264496-62e8-4db0-b0dc-412c6a775769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca00e50577146a8bffa69cb0ac98687, user_id=524552d1bd904565957bcb3431c7123e, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.834897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d264496-62e8-4db0-b0dc-412c6a775769 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:22.850231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 912/1832] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:22 2022] PUT /identity/v3/projects/1ca00e50577146a8bffa69cb0ac98687/users/524552d1bd904565957bcb3431c7123e/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:22.851048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d264496-62e8-4db0-b0dc-412c6a775769 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:22.878403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af70d58274d64bf892bc80aea43ab27a', 'request_id': 'req-74e662ee-459f-48f5-af0a-a4bf77468f72'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.880939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:22.886869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af70d58274d64bf892bc80aea43ab27a', 'request_id': 'req-74e662ee-459f-48f5-af0a-a4bf77468f72'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.892654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af70d58274d64bf892bc80aea43ab27a', 'request_id': 'req-74e662ee-459f-48f5-af0a-a4bf77468f72'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.907589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] The token cache is being invalidate because project af70d58274d64bf892bc80aea43ab27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:22.907878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.908506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-74e662ee-459f-48f5-af0a-a4bf77468f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:22.910197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 921/1833] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:22 2022] DELETE /identity/v3/projects/af70d58274d64bf892bc80aea43ab27a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:22.911372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020fd3-2fd0-431d-a0b4-b461210d1c10 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.911651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020fd3-2fd0-431d-a0b4-b461210d1c10 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.911924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020fd3-2fd0-431d-a0b4-b461210d1c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.920307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d264496-62e8-4db0-b0dc-412c6a775769 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:22.940915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2c020fd3-2fd0-431d-a0b4-b461210d1c10 None None] MFA Rules not processed for user `524552d1bd904565957bcb3431c7123e`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:22.942211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2c020fd3-2fd0-431d-a0b4-b461210d1c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:22.946178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:22.986504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aad9a6-3e08-4859-84e5-239e9ff4a990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:22.987856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aad9a6-3e08-4859-84e5-239e9ff4a990 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:22.988288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aad9a6-3e08-4859-84e5-239e9ff4a990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:22.988773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aad9a6-3e08-4859-84e5-239e9ff4a990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:22.989470 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aad9a6-3e08-4859-84e5-239e9ff4a990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:22.991310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aad9a6-3e08-4859-84e5-239e9ff4a990 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.003417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 913/1834] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:23.004675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fb33f-1396-4c16-aec5-e42b02a06f6b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.004951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fb33f-1396-4c16-aec5-e42b02a06f6b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.005230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fb33f-1396-4c16-aec5-e42b02a06f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.030750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a53fb33f-1396-4c16-aec5-e42b02a06f6b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:23.032210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a53fb33f-1396-4c16-aec5-e42b02a06f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:23.038504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 922/1835] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:23.038504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020fd3-2fd0-431d-a0b4-b461210d1c10 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.038504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2c020fd3-2fd0-431d-a0b4-b461210d1c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:23.054385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 914/1836] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:23.055325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020fd3-2fd0-431d-a0b4-b461210d1c10 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.055800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fb33f-1396-4c16-aec5-e42b02a06f6b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.057434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a53fb33f-1396-4c16-aec5-e42b02a06f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:23.060770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540559c4-4c8e-42f1-b01b-767578c6922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.061845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540559c4-4c8e-42f1-b01b-767578c6922c admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.062130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540559c4-4c8e-42f1-b01b-767578c6922c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.062406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540559c4-4c8e-42f1-b01b-767578c6922c admin admin] PATH_INFO: `/v3/projects/a4eff55d98d341ac87ceebdf11e5421a/users/9169e1bdc6354490865a75ffa906e2c6/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.074162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fb33f-1396-4c16-aec5-e42b02a06f6b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.079032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209e3fb-95e7-4439-a933-dd0adb5299d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.079648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209e3fb-95e7-4439-a933-dd0adb5299d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.079928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209e3fb-95e7-4439-a933-dd0adb5299d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.080200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209e3fb-95e7-4439-a933-dd0adb5299d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.080873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209e3fb-95e7-4439-a933-dd0adb5299d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.082962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209e3fb-95e7-4439-a933-dd0adb5299d1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.089333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540559c4-4c8e-42f1-b01b-767578c6922c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4eff55d98d341ac87ceebdf11e5421a, user_id=9169e1bdc6354490865a75ffa906e2c6, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.093165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540559c4-4c8e-42f1-b01b-767578c6922c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.119275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 915/1837] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:23.122350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 923/1838] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:23 2022] PUT /identity/v3/projects/a4eff55d98d341ac87ceebdf11e5421a/users/9169e1bdc6354490865a75ffa906e2c6/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:23.123400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540559c4-4c8e-42f1-b01b-767578c6922c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.126538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2185ecc-ad1b-4d9e-98d6-6591b4451b4f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.126989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2185ecc-ad1b-4d9e-98d6-6591b4451b4f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.127393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2185ecc-ad1b-4d9e-98d6-6591b4451b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.158902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c2185ecc-ad1b-4d9e-98d6-6591b4451b4f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:23.160198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c2185ecc-ad1b-4d9e-98d6-6591b4451b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:23.201354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540559c4-4c8e-42f1-b01b-767578c6922c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.228293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 916/1839] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:23.229727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3da2b-a30f-4076-bf00-0a994736e0d6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.230013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3da2b-a30f-4076-bf00-0a994736e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.230311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3da2b-a30f-4076-bf00-0a994736e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.249855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c3a3da2b-a30f-4076-bf00-0a994736e0d6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:23.251052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3a3da2b-a30f-4076-bf00-0a994736e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:23.258907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 917/1840] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:23.259979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3da2b-a30f-4076-bf00-0a994736e0d6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.263374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.264061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.264466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.264812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.265523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.267543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.271094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3da2b-a30f-4076-bf00-0a994736e0d6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.275661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.276262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.276539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.276814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.277789 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:23.278099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.279689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.293598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 924/1841] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:23.293598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.293875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 918/1842] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:23:23.294774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.295417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:23.306294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c744a-7db0-4ac6-ab30-22b2e07bbcfa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.311371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c711c-b40d-40fb-b46f-904ab9cb1d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.311973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c711c-b40d-40fb-b46f-904ab9cb1d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.312263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c711c-b40d-40fb-b46f-904ab9cb1d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.312540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c711c-b40d-40fb-b46f-904ab9cb1d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.313195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c711c-b40d-40fb-b46f-904ab9cb1d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.314830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c711c-b40d-40fb-b46f-904ab9cb1d95 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.319140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:23.326099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 919/1843] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:23.327161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c711c-b40d-40fb-b46f-904ab9cb1d95 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.337627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c711c-b40d-40fb-b46f-904ab9cb1d95 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.342414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcd09c-cadf-4668-ae01-80b9aea3ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.343022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd09c-cadf-4668-ae01-80b9aea3ce4c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.343310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd09c-cadf-4668-ae01-80b9aea3ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.343592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd09c-cadf-4668-ae01-80b9aea3ce4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.344232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcd09c-cadf-4668-ae01-80b9aea3ce4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.347494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcd09c-cadf-4668-ae01-80b9aea3ce4c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.352461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:23.382122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284566-d1ec-4bcb-88c5-ae84e52630d8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.386071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c839229-fa67-4929-921e-27736761a03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.386783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839229-fa67-4929-921e-27736761a03c service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.387298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839229-fa67-4929-921e-27736761a03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.387401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 920/1844] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:23.387966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcd09c-cadf-4668-ae01-80b9aea3ce4c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.389950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839229-fa67-4929-921e-27736761a03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.400923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c839229-fa67-4929-921e-27736761a03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.402676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c839229-fa67-4929-921e-27736761a03c service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.418303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 925/1845] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:23.419507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c839229-fa67-4929-921e-27736761a03c service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.431956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c839229-fa67-4929-921e-27736761a03c service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.466299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcd09c-cadf-4668-ae01-80b9aea3ce4c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.472279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e53c-9878-40cc-b768-18bf58ccb24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.473134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e53c-9878-40cc-b768-18bf58ccb24d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.473348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e53c-9878-40cc-b768-18bf58ccb24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.474322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e53c-9878-40cc-b768-18bf58ccb24d admin admin] PATH_INFO: `/v3/projects/5d11082f4a104db68b437b64026d5174/users/e7c5e766fe8e49baa69962b1f3ce4976/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.497817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584e53c-9878-40cc-b768-18bf58ccb24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d11082f4a104db68b437b64026d5174, user_id=e7c5e766fe8e49baa69962b1f3ce4976, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.502690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584e53c-9878-40cc-b768-18bf58ccb24d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.519793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 921/1846] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:23 2022] PUT /identity/v3/projects/5d11082f4a104db68b437b64026d5174/users/e7c5e766fe8e49baa69962b1f3ce4976/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:23.524226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e53c-9878-40cc-b768-18bf58ccb24d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.531407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb06b-b9d9-4143-a957-044c6845aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.532205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb06b-b9d9-4143-a957-044c6845aa05 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.532579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb06b-b9d9-4143-a957-044c6845aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.532945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb06b-b9d9-4143-a957-044c6845aa05 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.533758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eb06b-b9d9-4143-a957-044c6845aa05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.536983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eb06b-b9d9-4143-a957-044c6845aa05 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.565958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 926/1847] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/users => generated 301 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:23.567425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb06b-b9d9-4143-a957-044c6845aa05 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.585644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb06b-b9d9-4143-a957-044c6845aa05 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.622520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e53c-9878-40cc-b768-18bf58ccb24d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.630113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3798ce4-2af5-4bcc-9b2a-966a0610cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.631168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3798ce4-2af5-4bcc-9b2a-966a0610cf2a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.631168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3798ce4-2af5-4bcc-9b2a-966a0610cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.631572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3798ce4-2af5-4bcc-9b2a-966a0610cf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.632296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3798ce4-2af5-4bcc-9b2a-966a0610cf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.634002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3798ce4-2af5-4bcc-9b2a-966a0610cf2a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.648637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 922/1848] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:23.653050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3798ce4-2af5-4bcc-9b2a-966a0610cf2a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.662145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7062f0-1a07-4eee-89cd-1e82cb531f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.662838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7062f0-1a07-4eee-89cd-1e82cb531f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.663199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7062f0-1a07-4eee-89cd-1e82cb531f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.664260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7062f0-1a07-4eee-89cd-1e82cb531f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.664260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7062f0-1a07-4eee-89cd-1e82cb531f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.666194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7062f0-1a07-4eee-89cd-1e82cb531f42 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.680135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 927/1849] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:23.680394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3798ce4-2af5-4bcc-9b2a-966a0610cf2a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.684650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7062f0-1a07-4eee-89cd-1e82cb531f42 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.688917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b284611-664c-4d5c-97f7-75c203540b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.690374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284611-664c-4d5c-97f7-75c203540b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.690877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284611-664c-4d5c-97f7-75c203540b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.691495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284611-664c-4d5c-97f7-75c203540b33 admin admin] PATH_INFO: `/v3/projects/5d11082f4a104db68b437b64026d5174/users/e7c5e766fe8e49baa69962b1f3ce4976/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.695227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7062f0-1a07-4eee-89cd-1e82cb531f42 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.698584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b284611-664c-4d5c-97f7-75c203540b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d11082f4a104db68b437b64026d5174, user_id=e7c5e766fe8e49baa69962b1f3ce4976, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.700843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f7c1-94c5-44e8-82d1-a8ed417f2940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.701820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f7c1-94c5-44e8-82d1-a8ed417f2940 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.702253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b284611-664c-4d5c-97f7-75c203540b33 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.702371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f7c1-94c5-44e8-82d1-a8ed417f2940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.702776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f7c1-94c5-44e8-82d1-a8ed417f2940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.703838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f7c1-94c5-44e8-82d1-a8ed417f2940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.706283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f7c1-94c5-44e8-82d1-a8ed417f2940 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.717250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 923/1850] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:23 2022] PUT /identity/v3/projects/5d11082f4a104db68b437b64026d5174/users/e7c5e766fe8e49baa69962b1f3ce4976/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:23.729313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c3710-3545-48d8-b510-2cda6319824b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.730423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c3710-3545-48d8-b510-2cda6319824b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.730793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c3710-3545-48d8-b510-2cda6319824b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.734377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 928/1851] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:23.735603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f7c1-94c5-44e8-82d1-a8ed417f2940 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.750015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f7c1-94c5-44e8-82d1-a8ed417f2940 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:23.779274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0c9c3710-3545-48d8-b510-2cda6319824b None None] MFA Rules not processed for user `e7c5e766fe8e49baa69962b1f3ce4976`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:23.780581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c9c3710-3545-48d8-b510-2cda6319824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:23.809906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:23.846143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:23.859375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b381c-047a-46d7-b7bd-2cce35cb2299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:23.860316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b381c-047a-46d7-b7bd-2cce35cb2299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.860607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b381c-047a-46d7-b7bd-2cce35cb2299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.860886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b381c-047a-46d7-b7bd-2cce35cb2299 admin admin] PATH_INFO: `/v3/projects/772ff8bd119a49e1bae69c405b651491/users/fae56b85f4b74559a2bf57222fa56717/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.879230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b381c-047a-46d7-b7bd-2cce35cb2299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772ff8bd119a49e1bae69c405b651491, user_id=fae56b85f4b74559a2bf57222fa56717, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:23.882380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b381c-047a-46d7-b7bd-2cce35cb2299 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:23.898875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 929/1852] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:23 2022] PUT /identity/v3/projects/772ff8bd119a49e1bae69c405b651491/users/fae56b85f4b74559a2bf57222fa56717/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:23.904744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 924/1853] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:23.915079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9415e6-36f3-4b82-a142-5c950559bb1b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:23.915364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9415e6-36f3-4b82-a142-5c950559bb1b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:23.915639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9415e6-36f3-4b82-a142-5c950559bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:23.918568 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c3710-3545-48d8-b510-2cda6319824b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:23.920106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c9c3710-3545-48d8-b510-2cda6319824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:23.949230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-dd9415e6-36f3-4b82-a142-5c950559bb1b None None] MFA Rules not processed for user `fae56b85f4b74559a2bf57222fa56717`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:23.950751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dd9415e6-36f3-4b82-a142-5c950559bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:24.007593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c3710-3545-48d8-b510-2cda6319824b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.023596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 930/1854] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:24.028507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9415e6-36f3-4b82-a142-5c950559bb1b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.067764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398bbc8-5ac2-4e2c-89b2-d09c171d9638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.068651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398bbc8-5ac2-4e2c-89b2-d09c171d9638 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.068933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398bbc8-5ac2-4e2c-89b2-d09c171d9638 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.070285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398bbc8-5ac2-4e2c-89b2-d09c171d9638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.104123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9415e6-36f3-4b82-a142-5c950559bb1b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.109064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff1c0-3773-4d6f-9e79-97507aeca3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.109735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff1c0-3773-4d6f-9e79-97507aeca3ee admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.110019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff1c0-3773-4d6f-9e79-97507aeca3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.110368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff1c0-3773-4d6f-9e79-97507aeca3ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.111037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ff1c0-3773-4d6f-9e79-97507aeca3ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.113518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ff1c0-3773-4d6f-9e79-97507aeca3ee admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.146028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 931/1855] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:24 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:23:24.149930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff1c0-3773-4d6f-9e79-97507aeca3ee admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.151129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398bbc8-5ac2-4e2c-89b2-d09c171d9638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.153163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398bbc8-5ac2-4e2c-89b2-d09c171d9638 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.169288 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 925/1856] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:23:24.227396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398bbc8-5ac2-4e2c-89b2-d09c171d9638 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.241970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:24.245310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398bbc8-5ac2-4e2c-89b2-d09c171d9638 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.275288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff1c0-3773-4d6f-9e79-97507aeca3ee admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.281312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a9e83-499d-4fe0-ba24-9ac9d208dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.281939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a9e83-499d-4fe0-ba24-9ac9d208dc87 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.282315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a9e83-499d-4fe0-ba24-9ac9d208dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.285802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a9e83-499d-4fe0-ba24-9ac9d208dc87 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.285802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a9e83-499d-4fe0-ba24-9ac9d208dc87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.286362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a9e83-499d-4fe0-ba24-9ac9d208dc87 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.323035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 932/1857] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:24 2022] POST /identity/v3/users => generated 307 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:23:24.325630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ab89-f271-4854-a4a8-9dcd1e807813 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.326120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ab89-f271-4854-a4a8-9dcd1e807813 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.326579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ab89-f271-4854-a4a8-9dcd1e807813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.350377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:24.385902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5db3ab89-f271-4854-a4a8-9dcd1e807813 None None] MFA Rules not processed for user `9169e1bdc6354490865a75ffa906e2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:24.386216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.386895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.387179 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.387453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] PATH_INFO: `/v3/users/524552d1bd904565957bcb3431c7123e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.388586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5db3ab89-f271-4854-a4a8-9dcd1e807813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:24.389486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524552d1bd904565957bcb3431c7123e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.393056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.493901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524552d1bd904565957bcb3431c7123e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:24.494863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524552d1bd904565957bcb3431c7123e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:24.504384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 933/1858] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:24.505389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3ab89-f271-4854-a4a8-9dcd1e807813 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.507120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524552d1bd904565957bcb3431c7123e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:24.516225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3ab89-f271-4854-a4a8-9dcd1e807813 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.522085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.522703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.523008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.523259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.523914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.524139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524552d1bd904565957bcb3431c7123e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:24.525566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.533028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524552d1bd904565957bcb3431c7123e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:24.537009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 934/1859] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:24.538043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.542495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:24.542985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 926/1860] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:24 2022] DELETE /identity/v3/users/524552d1bd904565957bcb3431c7123e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:24.545633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.547681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:24.558289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c306a-6cba-4c9a-87a4-02b55047709c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.626330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b910f-3cd4-4751-8344-e8d8d2cdce00 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.630420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43140a-6ce8-4a37-9e78-84cf6b20dc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.631119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43140a-6ce8-4a37-9e78-84cf6b20dc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.631412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43140a-6ce8-4a37-9e78-84cf6b20dc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.631684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43140a-6ce8-4a37-9e78-84cf6b20dc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.632332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43140a-6ce8-4a37-9e78-84cf6b20dc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.632645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511533-554e-4c01-9a6f-f2569bb75c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.633489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511533-554e-4c01-9a6f-f2569bb75c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.633965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511533-554e-4c01-9a6f-f2569bb75c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.634368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43140a-6ce8-4a37-9e78-84cf6b20dc2b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.634546 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511533-554e-4c01-9a6f-f2569bb75c59 admin admin] PATH_INFO: `/v3/projects/5e6e947447894498bf6aebd594d58c9e/users/a6767aa4cfad4904b1a3543bd2d932dd/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.656212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59511533-554e-4c01-9a6f-f2569bb75c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6e947447894498bf6aebd594d58c9e, user_id=a6767aa4cfad4904b1a3543bd2d932dd, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.661191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59511533-554e-4c01-9a6f-f2569bb75c59 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.683966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 927/1861] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:24 2022] PUT /identity/v3/projects/5e6e947447894498bf6aebd594d58c9e/users/a6767aa4cfad4904b1a3543bd2d932dd/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:24.684188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 935/1862] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:24 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:24.684188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43140a-6ce8-4a37-9e78-84cf6b20dc2b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.684505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af7b4-fb0e-4def-af05-858bbe470b5a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.684505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af7b4-fb0e-4def-af05-858bbe470b5a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.684967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af7b4-fb0e-4def-af05-858bbe470b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.715117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4c9af7b4-fb0e-4def-af05-858bbe470b5a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:24.716383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4c9af7b4-fb0e-4def-af05-858bbe470b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:24.718909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:24.755986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43140a-6ce8-4a37-9e78-84cf6b20dc2b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.760835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523e98-08b4-46fb-963e-aa530fedcf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.761445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523e98-08b4-46fb-963e-aa530fedcf9d admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.761760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523e98-08b4-46fb-963e-aa530fedcf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.762094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523e98-08b4-46fb-963e-aa530fedcf9d admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.762736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3523e98-08b4-46fb-963e-aa530fedcf9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.764665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3523e98-08b4-46fb-963e-aa530fedcf9d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.773429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:24.791074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 936/1863] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:24 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:24.791074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523e98-08b4-46fb-963e-aa530fedcf9d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.795519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 928/1864] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:24.796340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af7b4-fb0e-4def-af05-858bbe470b5a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.804872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523e98-08b4-46fb-963e-aa530fedcf9d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.805412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af7b4-fb0e-4def-af05-858bbe470b5a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.809691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.810276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b693556-a9b9-4612-a2d3-ef12f647c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.810437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.810627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.810866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693556-a9b9-4612-a2d3-ef12f647c06c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.810957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.811145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693556-a9b9-4612-a2d3-ef12f647c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.811537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693556-a9b9-4612-a2d3-ef12f647c06c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.811654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.812183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b693556-a9b9-4612-a2d3-ef12f647c06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.813190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.813779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b693556-a9b9-4612-a2d3-ef12f647c06c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.824427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 937/1865] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:24.824955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 929/1866] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:24.825373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.827112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:24.828360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b693556-a9b9-4612-a2d3-ef12f647c06c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.838796 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b693556-a9b9-4612-a2d3-ef12f647c06c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.843664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d421-dee4-4065-881b-73f3ac6d4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.844378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d421-dee4-4065-881b-73f3ac6d4a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.844658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d421-dee4-4065-881b-73f3ac6d4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.844963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d421-dee4-4065-881b-73f3ac6d4a2d admin admin] PATH_INFO: `/v3/projects/5e6e947447894498bf6aebd594d58c9e/users/a6767aa4cfad4904b1a3543bd2d932dd/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.847622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2d421-dee4-4065-881b-73f3ac6d4a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6e947447894498bf6aebd594d58c9e, user_id=a6767aa4cfad4904b1a3543bd2d932dd, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:24.850413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2d421-dee4-4065-881b-73f3ac6d4a2d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:24.871765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 930/1867] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:24 2022] PUT /identity/v3/projects/5e6e947447894498bf6aebd594d58c9e/users/a6767aa4cfad4904b1a3543bd2d932dd/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:24.871765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d421-dee4-4065-881b-73f3ac6d4a2d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:24.922689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd817d-5397-46d5-a4be-e3db6bd10ecc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.984865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d421-dee4-4065-881b-73f3ac6d4a2d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:24.992153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27cfc-d509-462e-aacc-3b0ffd7d30ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:24.992914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27cfc-d509-462e-aacc-3b0ffd7d30ca service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:24.993215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27cfc-d509-462e-aacc-3b0ffd7d30ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:24.993567 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27cfc-d509-462e-aacc-3b0ffd7d30ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:24.999538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931cd4c-3173-4800-9c44-73e7ff15f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:25.000597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931cd4c-3173-4800-9c44-73e7ff15f4af admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:25.001173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931cd4c-3173-4800-9c44-73e7ff15f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:25.001502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931cd4c-3173-4800-9c44-73e7ff15f4af admin admin] PATH_INFO: `/v3/projects/0b710cc835ff4b8eb661e8e7dcfa920a/users/566ad34713d54992a301e9566ec73f84/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:25.012031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27cfc-d509-462e-aacc-3b0ffd7d30ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:25.013777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27cfc-d509-462e-aacc-3b0ffd7d30ca service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:25.027836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 938/1868] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:25.030258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552f0fe-4e46-43b9-9576-900ab5e2a501 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:25.030869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552f0fe-4e46-43b9-9576-900ab5e2a501 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:25.031565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552f0fe-4e46-43b9-9576-900ab5e2a501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:25.043881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931cd4c-3173-4800-9c44-73e7ff15f4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b710cc835ff4b8eb661e8e7dcfa920a, user_id=566ad34713d54992a301e9566ec73f84, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:25.052868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931cd4c-3173-4800-9c44-73e7ff15f4af admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:25.086068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2552f0fe-4e46-43b9-9576-900ab5e2a501 None None] MFA Rules not processed for user `a6767aa4cfad4904b1a3543bd2d932dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:25.087554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2552f0fe-4e46-43b9-9576-900ab5e2a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:25.096520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 931/1869] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:24 2022] PUT /identity/v3/projects/0b710cc835ff4b8eb661e8e7dcfa920a/users/566ad34713d54992a301e9566ec73f84/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:25.097621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931cd4c-3173-4800-9c44-73e7ff15f4af admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:25.222144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:25.288871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 939/1870] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:25.297033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931cd4c-3173-4800-9c44-73e7ff15f4af admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:25.317353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552f0fe-4e46-43b9-9576-900ab5e2a501 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:25.325016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2552f0fe-4e46-43b9-9576-900ab5e2a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:25.328009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24dc2d-509a-4ee6-aa55-45cbc37a6d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:25.329409 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24dc2d-509a-4ee6-aa55-45cbc37a6d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:25.330395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24dc2d-509a-4ee6-aa55-45cbc37a6d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:25.330954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24dc2d-509a-4ee6-aa55-45cbc37a6d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:25.333180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24dc2d-509a-4ee6-aa55-45cbc37a6d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:25.338931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24dc2d-509a-4ee6-aa55-45cbc37a6d91 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:25.358105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 932/1871] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:25.363381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24dc2d-509a-4ee6-aa55-45cbc37a6d91 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:25.380937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24dc2d-509a-4ee6-aa55-45cbc37a6d91 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:25.387307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0d1cb-e6f9-4f80-b63d-59267048ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:25.388323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0d1cb-e6f9-4f80-b63d-59267048ace0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:25.388856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0d1cb-e6f9-4f80-b63d-59267048ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:25.390069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0d1cb-e6f9-4f80-b63d-59267048ace0 admin admin] PATH_INFO: `/v3/projects/0b710cc835ff4b8eb661e8e7dcfa920a/users/566ad34713d54992a301e9566ec73f84/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:25.393236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0d1cb-e6f9-4f80-b63d-59267048ace0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b710cc835ff4b8eb661e8e7dcfa920a, user_id=566ad34713d54992a301e9566ec73f84, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:25.399300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0d1cb-e6f9-4f80-b63d-59267048ace0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:25.432934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 933/1872] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:25 2022] PUT /identity/v3/projects/0b710cc835ff4b8eb661e8e7dcfa920a/users/566ad34713d54992a301e9566ec73f84/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:25.462998 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552f0fe-4e46-43b9-9576-900ab5e2a501 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:25.556201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:25.556925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:25.557080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:25.557353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:25.651858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:25.654360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:25.668826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 940/1873] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:25.760032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0d1cb-e6f9-4f80-b63d-59267048ace0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:25.779104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0d1cb-e6f9-4f80-b63d-59267048ace0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:25.785746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:25.786802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:25.787841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:25.787841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:25.790553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:25.826542 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:25.882947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:25.885145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:25.898840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 934/1874] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:27.274481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:27.276866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:27.389993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:27.399299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dedf2-5271-4966-93b0-c0f044460624 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:27.406152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:27.407768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:27.408415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:27.409259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] PATH_INFO: `/v3/projects/1ca00e50577146a8bffa69cb0ac98687` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:27.411649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca00e50577146a8bffa69cb0ac98687)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:27.414530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:27.535245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca00e50577146a8bffa69cb0ac98687', 'request_id': 'req-c28a55be-06bc-43fe-ab4e-165fd2713229'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.543446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca00e50577146a8bffa69cb0ac98687', 'request_id': 'req-c28a55be-06bc-43fe-ab4e-165fd2713229'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.554045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca00e50577146a8bffa69cb0ac98687', 'request_id': 'req-c28a55be-06bc-43fe-ab4e-165fd2713229'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.577831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] The token cache is being invalidate because project 1ca00e50577146a8bffa69cb0ac98687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:27.578703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.579015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c28a55be-06bc-43fe-ab4e-165fd2713229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.584297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 941/1875] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:27 2022] DELETE /identity/v3/projects/1ca00e50577146a8bffa69cb0ac98687 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:27.585476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:27.613045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d5844-237a-4b9b-bcb5-766a6ac705c8 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:27.690068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:27.691108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:27.691997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:27.692439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] PATH_INFO: `/v3/users/e7c5e766fe8e49baa69962b1f3ce4976` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:27.694102 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c5e766fe8e49baa69962b1f3ce4976)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:27.696974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:27.773094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c5e766fe8e49baa69962b1f3ce4976'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.774248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c5e766fe8e49baa69962b1f3ce4976'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.785465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c5e766fe8e49baa69962b1f3ce4976'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.809122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c5e766fe8e49baa69962b1f3ce4976'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.852606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2afc03f0-58f1-4cf6-8919-14d815a39db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c5e766fe8e49baa69962b1f3ce4976'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:27.864968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 935/1876] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:27 2022] DELETE /identity/v3/users/e7c5e766fe8e49baa69962b1f3ce4976 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:28.177568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf455742-dc5b-42c6-9fac-8a7f5ac3e50e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:28.178142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf455742-dc5b-42c6-9fac-8a7f5ac3e50e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:28.178600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf455742-dc5b-42c6-9fac-8a7f5ac3e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:28.224932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cf455742-dc5b-42c6-9fac-8a7f5ac3e50e None None] MFA Rules not processed for user `566ad34713d54992a301e9566ec73f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:28.227059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cf455742-dc5b-42c6-9fac-8a7f5ac3e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:28.352186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3962d-480f-497a-a8d2-13af3ca0a4f5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:28.352375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 942/1877] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:28.353174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3962d-480f-497a-a8d2-13af3ca0a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:28.353458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3962d-480f-497a-a8d2-13af3ca0a4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:28.386417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-05e3962d-480f-497a-a8d2-13af3ca0a4f5 None None] MFA Rules not processed for user `9169e1bdc6354490865a75ffa906e2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:28.388485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-05e3962d-480f-497a-a8d2-13af3ca0a4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:28.474998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:28.494152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 936/1878] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:28.511014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf455742-dc5b-42c6-9fac-8a7f5ac3e50e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:28.512881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cf455742-dc5b-42c6-9fac-8a7f5ac3e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:28.624347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf455742-dc5b-42c6-9fac-8a7f5ac3e50e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:28.633427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:28.634114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:28.634401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:28.634679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:28.637376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:28.646089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea132-2227-468b-aacf-ac59d70d8359 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:28.647201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea132-2227-468b-aacf-ac59d70d8359 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:28.647494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea132-2227-468b-aacf-ac59d70d8359 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:28.649210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 937/1879] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:23:28.655273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:28.659437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:28.661919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:28.666373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69f29-4fa3-4d08-83fc-be4cd03815a6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:28.666548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69f29-4fa3-4d08-83fc-be4cd03815a6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:28.666833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69f29-4fa3-4d08-83fc-be4cd03815a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:28.714032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 943/1880] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:28.715416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b4f69f29-4fa3-4d08-83fc-be4cd03815a6 None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:28.717325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b4f69f29-4fa3-4d08-83fc-be4cd03815a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:28.730167 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 938/1881] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:28.782676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:28.785396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:28.896590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efcb70-29f2-45bd-b3fa-0d4bb257b00d service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:28.903567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69f29-4fa3-4d08-83fc-be4cd03815a6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:28.905329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b4f69f29-4fa3-4d08-83fc-be4cd03815a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:28.917948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:28.918721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:28.919068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:28.919409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] PATH_INFO: `/v3/projects/5d11082f4a104db68b437b64026d5174` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:28.920695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d11082f4a104db68b437b64026d5174)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:28.922719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:28.923398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69f29-4fa3-4d08-83fc-be4cd03815a6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:28.939572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a448e1b-790d-4ec1-9674-5e42b7ba0358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:28.942274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a448e1b-790d-4ec1-9674-5e42b7ba0358 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:28.943277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a448e1b-790d-4ec1-9674-5e42b7ba0358 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:28.943564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a448e1b-790d-4ec1-9674-5e42b7ba0358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:28.961703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a448e1b-790d-4ec1-9674-5e42b7ba0358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:28.963922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a448e1b-790d-4ec1-9674-5e42b7ba0358 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:28.980787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 939/1882] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:28.993048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d11082f4a104db68b437b64026d5174', 'request_id': 'req-3ae04c2c-3261-4e27-91e2-ac475a495b4a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:29.015433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d11082f4a104db68b437b64026d5174', 'request_id': 'req-3ae04c2c-3261-4e27-91e2-ac475a495b4a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:29.032831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d11082f4a104db68b437b64026d5174', 'request_id': 'req-3ae04c2c-3261-4e27-91e2-ac475a495b4a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:29.056322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] The token cache is being invalidate because project 5d11082f4a104db68b437b64026d5174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:29.056929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:29.057970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3ae04c2c-3261-4e27-91e2-ac475a495b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:29.066793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 944/1883] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:28 2022] DELETE /identity/v3/projects/5d11082f4a104db68b437b64026d5174 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:29.078646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8b6a7-8d59-42cb-bf72-cd1ef01404b0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.079001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8b6a7-8d59-42cb-bf72-cd1ef01404b0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.079640 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8b6a7-8d59-42cb-bf72-cd1ef01404b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.103249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-12c8b6a7-8d59-42cb-bf72-cd1ef01404b0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:29.104666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12c8b6a7-8d59-42cb-bf72-cd1ef01404b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:29.251234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 940/1884] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:29.257679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb69fa-ff2a-4d0b-b807-df6e94792630 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.258707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb69fa-ff2a-4d0b-b807-df6e94792630 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.259088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb69fa-ff2a-4d0b-b807-df6e94792630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.293750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a6fb69fa-ff2a-4d0b-b807-df6e94792630 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:29.295184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a6fb69fa-ff2a-4d0b-b807-df6e94792630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:29.313505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 945/1885] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:29.334854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8b6a7-8d59-42cb-bf72-cd1ef01404b0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:29.334854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8b6a7-8d59-42cb-bf72-cd1ef01404b0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:29.353077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:29.353871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.354105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.354314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.354992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:29.355410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:29.356909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:29.379133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 941/1886] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:23:29.383642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb69fa-ff2a-4d0b-b807-df6e94792630 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:29.396943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb69fa-ff2a-4d0b-b807-df6e94792630 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:29.405298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd1dd6-22c2-4ef3-9c5b-c25a1bd25bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:29.406035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd1dd6-22c2-4ef3-9c5b-c25a1bd25bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.406384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd1dd6-22c2-4ef3-9c5b-c25a1bd25bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.406745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd1dd6-22c2-4ef3-9c5b-c25a1bd25bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.407510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd1dd6-22c2-4ef3-9c5b-c25a1bd25bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:29.411929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd1dd6-22c2-4ef3-9c5b-c25a1bd25bc1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:29.480652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 946/1887] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:29 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:29.484655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:29.501787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de352b-9272-41c3-b9e7-7fe08f4f0ae6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:29.599183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997df4e-d15e-4409-9ca4-9e0f0d2006d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:29.600008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997df4e-d15e-4409-9ca4-9e0f0d2006d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.600323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997df4e-d15e-4409-9ca4-9e0f0d2006d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.600598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997df4e-d15e-4409-9ca4-9e0f0d2006d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.601332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997df4e-d15e-4409-9ca4-9e0f0d2006d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:29.603447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997df4e-d15e-4409-9ca4-9e0f0d2006d0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:29.653528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 942/1888] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:29 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:29.658093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd1dd6-22c2-4ef3-9c5b-c25a1bd25bc1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:29.676997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd1dd6-22c2-4ef3-9c5b-c25a1bd25bc1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:29.686084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858e4f8-b9e9-40d4-8d63-120bd3c1014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:29.687248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858e4f8-b9e9-40d4-8d63-120bd3c1014f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.687386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858e4f8-b9e9-40d4-8d63-120bd3c1014f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.687553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858e4f8-b9e9-40d4-8d63-120bd3c1014f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.688219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858e4f8-b9e9-40d4-8d63-120bd3c1014f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:29.690928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858e4f8-b9e9-40d4-8d63-120bd3c1014f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:29.714543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 947/1889] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:29.716320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997df4e-d15e-4409-9ca4-9e0f0d2006d0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:29.733712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997df4e-d15e-4409-9ca4-9e0f0d2006d0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:29.743344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8edf0c-1817-4521-8a90-377a3360b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:29.744632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8edf0c-1817-4521-8a90-377a3360b284 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.745182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8edf0c-1817-4521-8a90-377a3360b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.745733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8edf0c-1817-4521-8a90-377a3360b284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.746946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8edf0c-1817-4521-8a90-377a3360b284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:29.749353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8edf0c-1817-4521-8a90-377a3360b284 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:29.763372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 943/1890] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:29.767695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858e4f8-b9e9-40d4-8d63-120bd3c1014f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:29.779889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858e4f8-b9e9-40d4-8d63-120bd3c1014f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:29.785212 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f010fa-38b8-4cdf-8fa3-965af1505e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:29.785936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f010fa-38b8-4cdf-8fa3-965af1505e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.786219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f010fa-38b8-4cdf-8fa3-965af1505e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.786554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f010fa-38b8-4cdf-8fa3-965af1505e46 admin admin] PATH_INFO: `/v3/projects/62a9bf5d135b40b3b44efc7ef6ca249b/users/6d49078d310041598687bb7a8cc42e51/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.826327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f010fa-38b8-4cdf-8fa3-965af1505e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a9bf5d135b40b3b44efc7ef6ca249b, user_id=6d49078d310041598687bb7a8cc42e51, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:29.829709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f010fa-38b8-4cdf-8fa3-965af1505e46 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:29.858953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 948/1891] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:29 2022] PUT /identity/v3/projects/62a9bf5d135b40b3b44efc7ef6ca249b/users/6d49078d310041598687bb7a8cc42e51/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:29.870725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc802412-804e-4e93-a390-df58b9780161 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:29.871081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc802412-804e-4e93-a390-df58b9780161 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:29.871243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc802412-804e-4e93-a390-df58b9780161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:29.923931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bc802412-804e-4e93-a390-df58b9780161 None None] MFA Rules not processed for user `6d49078d310041598687bb7a8cc42e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:29.926140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bc802412-804e-4e93-a390-df58b9780161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:29.959926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:30.007026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 944/1892] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:30.008130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f010fa-38b8-4cdf-8fa3-965af1505e46 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.039250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:30.084964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f010fa-38b8-4cdf-8fa3-965af1505e46 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.090235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b229d2-7e86-4a88-af30-4f5a16a79450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.090850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b229d2-7e86-4a88-af30-4f5a16a79450 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.091157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b229d2-7e86-4a88-af30-4f5a16a79450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.091414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b229d2-7e86-4a88-af30-4f5a16a79450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.092071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b229d2-7e86-4a88-af30-4f5a16a79450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:30.094065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b229d2-7e86-4a88-af30-4f5a16a79450 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:30.151686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 949/1893] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:30 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:23:30.153360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc802412-804e-4e93-a390-df58b9780161 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.168437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc802412-804e-4e93-a390-df58b9780161 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.246564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa9c0a-99a5-458c-a9c6-5629dea8e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.247183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa9c0a-99a5-458c-a9c6-5629dea8e1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.247466 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa9c0a-99a5-458c-a9c6-5629dea8e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.247740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa9c0a-99a5-458c-a9c6-5629dea8e1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.248380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa9c0a-99a5-458c-a9c6-5629dea8e1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:30.250356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa9c0a-99a5-458c-a9c6-5629dea8e1e4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:30.276194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 945/1894] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:30 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:30.278048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b229d2-7e86-4a88-af30-4f5a16a79450 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.290863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b229d2-7e86-4a88-af30-4f5a16a79450 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.296638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4a207-02ea-48ae-9a11-07d6e2fe3873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.297468 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a207-02ea-48ae-9a11-07d6e2fe3873 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.297708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a207-02ea-48ae-9a11-07d6e2fe3873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.297876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a207-02ea-48ae-9a11-07d6e2fe3873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.302321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4a207-02ea-48ae-9a11-07d6e2fe3873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:30.303974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4a207-02ea-48ae-9a11-07d6e2fe3873 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:30.320877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 950/1895] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:30.325954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa9c0a-99a5-458c-a9c6-5629dea8e1e4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.337843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa9c0a-99a5-458c-a9c6-5629dea8e1e4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.344251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2e97d-b62b-428d-8a46-637b27857d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.345015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2e97d-b62b-428d-8a46-637b27857d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.345395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2e97d-b62b-428d-8a46-637b27857d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.345791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2e97d-b62b-428d-8a46-637b27857d10 admin admin] PATH_INFO: `/v3/projects/314b35d5a76645ca93386ec19efbaeaf/users/693bc469b0b344b2ac5030775149d87f/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.366142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2e97d-b62b-428d-8a46-637b27857d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314b35d5a76645ca93386ec19efbaeaf, user_id=693bc469b0b344b2ac5030775149d87f, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:30.369077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2e97d-b62b-428d-8a46-637b27857d10 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:30.388354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 946/1896] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:30 2022] PUT /identity/v3/projects/314b35d5a76645ca93386ec19efbaeaf/users/693bc469b0b344b2ac5030775149d87f/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:30.394173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4a207-02ea-48ae-9a11-07d6e2fe3873 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.409790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4a207-02ea-48ae-9a11-07d6e2fe3873 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.488248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39f2fb-d045-4636-b3b8-82082f1a7165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.488876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f2fb-d045-4636-b3b8-82082f1a7165 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.489164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f2fb-d045-4636-b3b8-82082f1a7165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.489444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f2fb-d045-4636-b3b8-82082f1a7165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.498418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39f2fb-d045-4636-b3b8-82082f1a7165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:30.501720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39f2fb-d045-4636-b3b8-82082f1a7165 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:30.521120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 951/1897] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:30.522445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2e97d-b62b-428d-8a46-637b27857d10 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.533381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2e97d-b62b-428d-8a46-637b27857d10 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.538405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.539092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.539862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.540152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] PATH_INFO: `/v3/projects/314b35d5a76645ca93386ec19efbaeaf/users/693bc469b0b344b2ac5030775149d87f/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.542799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314b35d5a76645ca93386ec19efbaeaf, user_id=693bc469b0b344b2ac5030775149d87f, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:30.545655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:30.558444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 947/1898] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:30 2022] PUT /identity/v3/projects/314b35d5a76645ca93386ec19efbaeaf/users/693bc469b0b344b2ac5030775149d87f/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:30.569683 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a061d8-061f-4657-9935-25f8628f3520 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.570200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a061d8-061f-4657-9935-25f8628f3520 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.570660 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a061d8-061f-4657-9935-25f8628f3520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.629566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c1a061d8-061f-4657-9935-25f8628f3520 None None] MFA Rules not processed for user `693bc469b0b344b2ac5030775149d87f`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:30.629566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c1a061d8-061f-4657-9935-25f8628f3520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:30.731672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 952/1899] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:30.742354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.748824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:30.785949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a061d8-061f-4657-9935-25f8628f3520 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.787672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c1a061d8-061f-4657-9935-25f8628f3520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:30.811676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:30.856403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267253b1-706d-4b8b-85a8-3207ca7620d4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.861080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.862580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.863010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.863292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.877957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:30.880805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:30.892087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 948/1900] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:30.905414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a061d8-061f-4657-9935-25f8628f3520 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.914291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.915054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.915336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.915616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] PATH_INFO: `/v3/users/fae56b85f4b74559a2bf57222fa56717` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.916897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae56b85f4b74559a2bf57222fa56717)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:30.919505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:30.963175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:30.965768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:30.980762 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e9f83-8793-4097-8223-a79356211dbc service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:30.990690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:30.991878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:30.992442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:30.993004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:30.997862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae56b85f4b74559a2bf57222fa56717'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:30.998924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae56b85f4b74559a2bf57222fa56717'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:30.999630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae56b85f4b74559a2bf57222fa56717'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.015384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae56b85f4b74559a2bf57222fa56717'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.021555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:31.025616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e774399e-5e59-49c0-8ea9-0c56b3618a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae56b85f4b74559a2bf57222fa56717'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.049528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 953/1901] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:30 2022] DELETE /identity/v3/users/fae56b85f4b74559a2bf57222fa56717 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:31.086350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06b95-714d-445a-9ebb-198f55ec0ae3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:31.086915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06b95-714d-445a-9ebb-198f55ec0ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:31.087210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06b95-714d-445a-9ebb-198f55ec0ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:31.121326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:31.122933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:31.138697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3ff06b95-714d-445a-9ebb-198f55ec0ae3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:31.140269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3ff06b95-714d-445a-9ebb-198f55ec0ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:31.150154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 949/1902] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:23:31.215909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 954/1903] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:31.241480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:31.242987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:31.312663 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1a40-8218-4177-bd92-20ad907f9721 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:31.368300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846551a2-5e1a-459f-b9d6-fe79a66d7a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:31.369016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846551a2-5e1a-459f-b9d6-fe79a66d7a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:31.369376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846551a2-5e1a-459f-b9d6-fe79a66d7a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:31.369750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846551a2-5e1a-459f-b9d6-fe79a66d7a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:31.380708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846551a2-5e1a-459f-b9d6-fe79a66d7a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:31.382196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846551a2-5e1a-459f-b9d6-fe79a66d7a77 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:31.394601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 950/1904] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:31.745473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06b95-714d-445a-9ebb-198f55ec0ae3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:31.746941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3ff06b95-714d-445a-9ebb-198f55ec0ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:31.760340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06b95-714d-445a-9ebb-198f55ec0ae3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:31.765451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:31.766135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:31.766417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:31.766696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] PATH_INFO: `/v3/projects/772ff8bd119a49e1bae69c405b651491` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:31.768995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=772ff8bd119a49e1bae69c405b651491)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:31.771343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:31.811939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:31.828564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772ff8bd119a49e1bae69c405b651491', 'request_id': 'req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.835616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772ff8bd119a49e1bae69c405b651491', 'request_id': 'req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.841092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772ff8bd119a49e1bae69c405b651491', 'request_id': 'req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.854062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] The token cache is being invalidate because project 772ff8bd119a49e1bae69c405b651491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:31.854352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.854976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.856468 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 955/1905] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:31 2022] DELETE /identity/v3/projects/772ff8bd119a49e1bae69c405b651491 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:31.860570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846551a2-5e1a-459f-b9d6-fe79a66d7a77 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:31.871698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846551a2-5e1a-459f-b9d6-fe79a66d7a77 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:31.936849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:31.937405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:31.937723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:31.938041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] PATH_INFO: `/v3/users/a6767aa4cfad4904b1a3543bd2d932dd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:31.939268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6767aa4cfad4904b1a3543bd2d932dd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:31.942617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:31.965780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:31.992664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6767aa4cfad4904b1a3543bd2d932dd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:31.993318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6767aa4cfad4904b1a3543bd2d932dd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.001629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6767aa4cfad4904b1a3543bd2d932dd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.015325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6767aa4cfad4904b1a3543bd2d932dd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.022562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-371c474d-b1de-4dc6-8d8e-9faa33f06e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6767aa4cfad4904b1a3543bd2d932dd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.029082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 951/1906] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:31 2022] DELETE /identity/v3/users/a6767aa4cfad4904b1a3543bd2d932dd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:32.415547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:32.417441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:32.445429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a40bc-e3fd-4e99-862b-d1b3fd91f96e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:32.540780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:32.541618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:32.541964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:32.542321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] PATH_INFO: `/v3/projects/5e6e947447894498bf6aebd594d58c9e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:32.543804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6e947447894498bf6aebd594d58c9e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:32.546085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:32.612240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6e947447894498bf6aebd594d58c9e', 'request_id': 'req-be04e92b-5478-4e5c-bc57-9b1ba268acbd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.619220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6e947447894498bf6aebd594d58c9e', 'request_id': 'req-be04e92b-5478-4e5c-bc57-9b1ba268acbd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.635938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6e947447894498bf6aebd594d58c9e', 'request_id': 'req-be04e92b-5478-4e5c-bc57-9b1ba268acbd'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.651975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] The token cache is being invalidate because project 5e6e947447894498bf6aebd594d58c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:32.652538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.653130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-be04e92b-5478-4e5c-bc57-9b1ba268acbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:32.655125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 956/1907] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:32 2022] DELETE /identity/v3/projects/5e6e947447894498bf6aebd594d58c9e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:32.660695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f876f-70c5-46f4-804c-3f3e8a1b8df6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:32.660986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f876f-70c5-46f4-804c-3f3e8a1b8df6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:32.661262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f876f-70c5-46f4-804c-3f3e8a1b8df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:32.684383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9a5f876f-70c5-46f4-804c-3f3e8a1b8df6 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:32.685719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a5f876f-70c5-46f4-804c-3f3e8a1b8df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:32.748590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 952/1908] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:32.757124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3fb89-b680-4c50-a047-9b54ad11aa5b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:32.757652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3fb89-b680-4c50-a047-9b54ad11aa5b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:32.758001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3fb89-b680-4c50-a047-9b54ad11aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:32.779240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3ab3fb89-b680-4c50-a047-9b54ad11aa5b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:32.780456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3ab3fb89-b680-4c50-a047-9b54ad11aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:32.788933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 957/1909] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:32.793323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f876f-70c5-46f4-804c-3f3e8a1b8df6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:32.804100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f876f-70c5-46f4-804c-3f3e8a1b8df6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:32.808877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:32.809487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:32.809805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:32.810094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:32.810779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:32.811090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:32.812697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:32.825867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 953/1910] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:23:32.830308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3fb89-b680-4c50-a047-9b54ad11aa5b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:32.839677 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3fb89-b680-4c50-a047-9b54ad11aa5b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:32.844513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b184f-e996-4b54-8344-230ca7fb29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:32.845116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b184f-e996-4b54-8344-230ca7fb29c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:32.845397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b184f-e996-4b54-8344-230ca7fb29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:32.845837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b184f-e996-4b54-8344-230ca7fb29c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:32.846484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b184f-e996-4b54-8344-230ca7fb29c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:32.848399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b184f-e996-4b54-8344-230ca7fb29c2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:32.881584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 958/1911] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:32 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:32.883778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:32.896771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb9a02-b7ec-44a1-9905-b61c97ac6382 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:32.977257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe8f0-708c-451b-8ad1-0d91e2faa1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:32.978109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe8f0-708c-451b-8ad1-0d91e2faa1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:32.978500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe8f0-708c-451b-8ad1-0d91e2faa1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:32.978882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe8f0-708c-451b-8ad1-0d91e2faa1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:32.979783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abe8f0-708c-451b-8ad1-0d91e2faa1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:32.982812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abe8f0-708c-451b-8ad1-0d91e2faa1d2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:33.030829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 954/1912] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:32 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:23:33.036758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b184f-e996-4b54-8344-230ca7fb29c2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:33.057586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b184f-e996-4b54-8344-230ca7fb29c2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:33.070825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44894b-fc75-4f08-9861-4f93b532709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:33.073329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44894b-fc75-4f08-9861-4f93b532709b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:33.073696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44894b-fc75-4f08-9861-4f93b532709b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:33.075568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44894b-fc75-4f08-9861-4f93b532709b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:33.076583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44894b-fc75-4f08-9861-4f93b532709b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:33.081592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44894b-fc75-4f08-9861-4f93b532709b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:33.100907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 959/1913] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:33.104488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe8f0-708c-451b-8ad1-0d91e2faa1d2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:33.115926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe8f0-708c-451b-8ad1-0d91e2faa1d2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:33.121183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab138bf-0605-4117-85a5-7445ef7eab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:33.121916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab138bf-0605-4117-85a5-7445ef7eab36 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:33.122299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab138bf-0605-4117-85a5-7445ef7eab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:33.122577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab138bf-0605-4117-85a5-7445ef7eab36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:33.123244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab138bf-0605-4117-85a5-7445ef7eab36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:33.126173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab138bf-0605-4117-85a5-7445ef7eab36 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:33.144293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 955/1914] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:33.145575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44894b-fc75-4f08-9861-4f93b532709b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:33.157355 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44894b-fc75-4f08-9861-4f93b532709b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:33.162635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:33.163301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:33.163585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:33.163864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] PATH_INFO: `/v3/projects/9c61e6d002214f9397a3be20859dcb4e/users/128eb1c497564e82b29a84db1f45131e/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:33.173103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:33.182997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c61e6d002214f9397a3be20859dcb4e, user_id=128eb1c497564e82b29a84db1f45131e, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:33.185999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:33.203265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 960/1915] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:33 2022] PUT /identity/v3/projects/9c61e6d002214f9397a3be20859dcb4e/users/128eb1c497564e82b29a84db1f45131e/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:33.224661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8276d9-e70a-482a-a0d4-009efdd7086d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:33.224661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8276d9-e70a-482a-a0d4-009efdd7086d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:33.224661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8276d9-e70a-482a-a0d4-009efdd7086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:33.233777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:33.257609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0b8276d9-e70a-482a-a0d4-009efdd7086d None None] MFA Rules not processed for user `128eb1c497564e82b29a84db1f45131e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:33.258943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b8276d9-e70a-482a-a0d4-009efdd7086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:33.338606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 956/1916] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:33.354745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:33.358344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:33.436949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26aad1-1f18-4a18-a5da-9053ded77e64 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:33.442596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c8761-1dcc-4093-8314-51c9bc9463ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:33.443399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c8761-1dcc-4093-8314-51c9bc9463ea service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:33.443829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c8761-1dcc-4093-8314-51c9bc9463ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:33.444100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c8761-1dcc-4093-8314-51c9bc9463ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:33.454153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c8761-1dcc-4093-8314-51c9bc9463ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:33.456471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c8761-1dcc-4093-8314-51c9bc9463ea service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:33.479962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 961/1917] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:34.890223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8276d9-e70a-482a-a0d4-009efdd7086d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:34.891771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b8276d9-e70a-482a-a0d4-009efdd7086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:35.063309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8276d9-e70a-482a-a0d4-009efdd7086d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:35.084623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:35.085674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:35.085674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:35.085924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] PATH_INFO: `/v3/users/6d49078d310041598687bb7a8cc42e51` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:35.087128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d49078d310041598687bb7a8cc42e51)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:35.089262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:35.181434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d49078d310041598687bb7a8cc42e51'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:35.182149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d49078d310041598687bb7a8cc42e51'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:35.192618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d49078d310041598687bb7a8cc42e51'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:35.209655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d49078d310041598687bb7a8cc42e51'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:35.239940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d49078d310041598687bb7a8cc42e51'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:35.252856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 957/1918] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:34 2022] DELETE /identity/v3/users/6d49078d310041598687bb7a8cc42e51 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:35.256215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa0dc-f532-4237-bc79-924bb2790b6a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:35.256703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa0dc-f532-4237-bc79-924bb2790b6a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:35.256806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa0dc-f532-4237-bc79-924bb2790b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:35.326199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c6dfa0dc-f532-4237-bc79-924bb2790b6a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:35.327604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c6dfa0dc-f532-4237-bc79-924bb2790b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:35.430535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 962/1919] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:35.441973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:35.443481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:35.470324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:35.587702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d21b-a2d1-4e6a-8930-f8d7ad5cbea7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:35.598860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037f9d-9300-44db-bfd4-4452ee03198b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:35.600059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037f9d-9300-44db-bfd4-4452ee03198b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:35.600370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037f9d-9300-44db-bfd4-4452ee03198b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:35.601004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037f9d-9300-44db-bfd4-4452ee03198b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:35.619927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85037f9d-9300-44db-bfd4-4452ee03198b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:35.621448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85037f9d-9300-44db-bfd4-4452ee03198b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:35.635354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 958/1920] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:36.215327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfa0dc-f532-4237-bc79-924bb2790b6a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:36.216747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c6dfa0dc-f532-4237-bc79-924bb2790b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:36.237968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfa0dc-f532-4237-bc79-924bb2790b6a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:36.248045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:36.248920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:36.249761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:36.250155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] PATH_INFO: `/v3/projects/62a9bf5d135b40b3b44efc7ef6ca249b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:36.252379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a9bf5d135b40b3b44efc7ef6ca249b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:36.255054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:36.339826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a9bf5d135b40b3b44efc7ef6ca249b', 'request_id': 'req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.350331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a9bf5d135b40b3b44efc7ef6ca249b', 'request_id': 'req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.359344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a9bf5d135b40b3b44efc7ef6ca249b', 'request_id': 'req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.378948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] The token cache is being invalidate because project 62a9bf5d135b40b3b44efc7ef6ca249b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:36.379443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.380244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.382536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 963/1921] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:36 2022] DELETE /identity/v3/projects/62a9bf5d135b40b3b44efc7ef6ca249b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:36.390992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037f9d-9300-44db-bfd4-4452ee03198b service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:36.405620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037f9d-9300-44db-bfd4-4452ee03198b service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:36.465866 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:36.466841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:36.467291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:36.467572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] PATH_INFO: `/v3/users/693bc469b0b344b2ac5030775149d87f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:36.468712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693bc469b0b344b2ac5030775149d87f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:36.470719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:36.520521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693bc469b0b344b2ac5030775149d87f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.521295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693bc469b0b344b2ac5030775149d87f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.530498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693bc469b0b344b2ac5030775149d87f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.544612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693bc469b0b344b2ac5030775149d87f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.556245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693bc469b0b344b2ac5030775149d87f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:36.562645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 959/1922] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:36 2022] DELETE /identity/v3/users/693bc469b0b344b2ac5030775149d87f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:36.841038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:36.842543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:36.857017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed72b5-23a8-44c8-b5ad-e5058cef9eb4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:36.871679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:36.933004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:36.933685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:36.933969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:36.934248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] PATH_INFO: `/v3/projects/314b35d5a76645ca93386ec19efbaeaf` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:36.935768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=314b35d5a76645ca93386ec19efbaeaf)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:36.937751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:36.989066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:36.990882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:37.006484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e92e-8184-49de-a34d-9bfd4f3cc639 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.020253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314b35d5a76645ca93386ec19efbaeaf', 'request_id': 'req-05aef06f-05c3-4dec-8669-dab9439ed4e3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.029519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314b35d5a76645ca93386ec19efbaeaf', 'request_id': 'req-05aef06f-05c3-4dec-8669-dab9439ed4e3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.037218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314b35d5a76645ca93386ec19efbaeaf', 'request_id': 'req-05aef06f-05c3-4dec-8669-dab9439ed4e3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.059283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] The token cache is being invalidate because project 314b35d5a76645ca93386ec19efbaeaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:37.059738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.060434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-05aef06f-05c3-4dec-8669-dab9439ed4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.060709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:37.067809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 964/1923] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:36 2022] DELETE /identity/v3/projects/314b35d5a76645ca93386ec19efbaeaf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:37.085832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2cf8d-8ab1-45c3-8e58-01bb7e3b7695 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.086196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2cf8d-8ab1-45c3-8e58-01bb7e3b7695 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.086393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2cf8d-8ab1-45c3-8e58-01bb7e3b7695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.135196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4cb2cf8d-8ab1-45c3-8e58-01bb7e3b7695 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:37.136962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4cb2cf8d-8ab1-45c3-8e58-01bb7e3b7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:37.138739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.139371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.139661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.139943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] PATH_INFO: `/v3/users/128eb1c497564e82b29a84db1f45131e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.143120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=128eb1c497564e82b29a84db1f45131e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.145435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.162021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 965/1924] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:37.164592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cfa6d-aaba-4572-9185-2bf93ae3eb00 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.164881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cfa6d-aaba-4572-9185-2bf93ae3eb00 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.165454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cfa6d-aaba-4572-9185-2bf93ae3eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.231078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f68cfa6d-aaba-4572-9185-2bf93ae3eb00 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:37.232856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f68cfa6d-aaba-4572-9185-2bf93ae3eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:37.243148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128eb1c497564e82b29a84db1f45131e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.244059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128eb1c497564e82b29a84db1f45131e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.250449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 966/1925] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:37.255940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cfa6d-aaba-4572-9185-2bf93ae3eb00 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.262863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128eb1c497564e82b29a84db1f45131e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.268206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cfa6d-aaba-4572-9185-2bf93ae3eb00 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.273324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.274373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.274659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.275510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.276319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:37.276628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.278512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.290496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128eb1c497564e82b29a84db1f45131e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.293743 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 967/1926] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:23:37.297996 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.301064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e8df319f-eb86-42b7-bf58-c483d7e1a791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128eb1c497564e82b29a84db1f45131e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.301488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:37.310976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 960/1927] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:36 2022] DELETE /identity/v3/users/128eb1c497564e82b29a84db1f45131e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:37.312561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9900e9-e50a-4a0d-8f35-e2b24d45a45f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.312858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9900e9-e50a-4a0d-8f35-e2b24d45a45f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.313140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9900e9-e50a-4a0d-8f35-e2b24d45a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.318171 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb190ba-e5a7-46da-a436-54629736d650 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.347889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7a9900e9-e50a-4a0d-8f35-e2b24d45a45f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:37.349312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7a9900e9-e50a-4a0d-8f35-e2b24d45a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:37.382279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321e1e6-2025-4840-bd1b-5db931709fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.382932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321e1e6-2025-4840-bd1b-5db931709fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.383842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321e1e6-2025-4840-bd1b-5db931709fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.384130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321e1e6-2025-4840-bd1b-5db931709fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.384780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321e1e6-2025-4840-bd1b-5db931709fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.386897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321e1e6-2025-4840-bd1b-5db931709fc6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.429063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 968/1928] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:37 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:23:37.430266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321e1e6-2025-4840-bd1b-5db931709fc6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.431724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 961/1929] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:37.440125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:37.444925 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9900e9-e50a-4a0d-8f35-e2b24d45a45f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.447353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7a9900e9-e50a-4a0d-8f35-e2b24d45a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:37.540334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9900e9-e50a-4a0d-8f35-e2b24d45a45f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.547557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321e1e6-2025-4840-bd1b-5db931709fc6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.552538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:37.554298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dd3ff-aa15-485d-85fd-89417ec6f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.555639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dd3ff-aa15-485d-85fd-89417ec6f8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.556045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dd3ff-aa15-485d-85fd-89417ec6f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.556437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dd3ff-aa15-485d-85fd-89417ec6f8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.557103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dd3ff-aa15-485d-85fd-89417ec6f8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.559729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dd3ff-aa15-485d-85fd-89417ec6f8b3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.589410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 969/1930] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:37 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:37.590624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dd3ff-aa15-485d-85fd-89417ec6f8b3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.601358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e447f-764b-4631-97a5-cbfb7c792486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.601679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dd3ff-aa15-485d-85fd-89417ec6f8b3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.602165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e447f-764b-4631-97a5-cbfb7c792486 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.602466 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e447f-764b-4631-97a5-cbfb7c792486 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.602730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e447f-764b-4631-97a5-cbfb7c792486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.606295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f8fb-2d3c-483a-9598-85deac30b147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.606887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f8fb-2d3c-483a-9598-85deac30b147 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.607162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f8fb-2d3c-483a-9598-85deac30b147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.607432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f8fb-2d3c-483a-9598-85deac30b147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.608071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6f8fb-2d3c-483a-9598-85deac30b147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.609717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6f8fb-2d3c-483a-9598-85deac30b147 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.617719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e447f-764b-4631-97a5-cbfb7c792486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.619243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e447f-764b-4631-97a5-cbfb7c792486 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.621826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 970/1931] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:37.625565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f8fb-2d3c-483a-9598-85deac30b147 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.629835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 962/1932] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:23:37.635887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f8fb-2d3c-483a-9598-85deac30b147 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.640786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c3e5d-7d1d-4269-b817-de23c3f89348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.641458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3e5d-7d1d-4269-b817-de23c3f89348 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.641856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3e5d-7d1d-4269-b817-de23c3f89348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.642338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3e5d-7d1d-4269-b817-de23c3f89348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.643023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c3e5d-7d1d-4269-b817-de23c3f89348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.644632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c3e5d-7d1d-4269-b817-de23c3f89348 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.656107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 971/1933] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:37.660617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e447f-764b-4631-97a5-cbfb7c792486 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.670492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e447f-764b-4631-97a5-cbfb7c792486 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.675985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfd1b1-40c6-490c-bcb5-1db2fc8e520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.676678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfd1b1-40c6-490c-bcb5-1db2fc8e520c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.677090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfd1b1-40c6-490c-bcb5-1db2fc8e520c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.677375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfd1b1-40c6-490c-bcb5-1db2fc8e520c admin admin] PATH_INFO: `/v3/projects/1912bbbc3efb4230b5030c2ee33007ee/users/e709af7aa8234be49ebd644608f2bec8/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.694080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfd1b1-40c6-490c-bcb5-1db2fc8e520c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1912bbbc3efb4230b5030c2ee33007ee, user_id=e709af7aa8234be49ebd644608f2bec8, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.697169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfd1b1-40c6-490c-bcb5-1db2fc8e520c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.711308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 963/1934] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:37 2022] PUT /identity/v3/projects/1912bbbc3efb4230b5030c2ee33007ee/users/e709af7aa8234be49ebd644608f2bec8/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:37.723233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f3e6-5811-4369-87fd-96ca629cd421 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.723584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f3e6-5811-4369-87fd-96ca629cd421 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.723918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f3e6-5811-4369-87fd-96ca629cd421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.753165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b174f3e6-5811-4369-87fd-96ca629cd421 None None] MFA Rules not processed for user `e709af7aa8234be49ebd644608f2bec8`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:37.754434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b174f3e6-5811-4369-87fd-96ca629cd421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:37.829361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 972/1935] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:37.834707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfd1b1-40c6-490c-bcb5-1db2fc8e520c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.899031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfd1b1-40c6-490c-bcb5-1db2fc8e520c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.906536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03360c2-2ae6-453b-8610-c10d4afd37e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.907014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f3e6-5811-4369-87fd-96ca629cd421 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.907218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03360c2-2ae6-453b-8610-c10d4afd37e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.907506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03360c2-2ae6-453b-8610-c10d4afd37e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.908085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03360c2-2ae6-453b-8610-c10d4afd37e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.908445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b174f3e6-5811-4369-87fd-96ca629cd421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:37.908551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03360c2-2ae6-453b-8610-c10d4afd37e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.910597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03360c2-2ae6-453b-8610-c10d4afd37e7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.925737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f3e6-5811-4369-87fd-96ca629cd421 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:37.932140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:37.933487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:37.933832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:37.934330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] PATH_INFO: `/v3/projects/9c61e6d002214f9397a3be20859dcb4e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:37.935568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c61e6d002214f9397a3be20859dcb4e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:37.938079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:37.943589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 964/1936] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:37 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:37.947535 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03360c2-2ae6-453b-8610-c10d4afd37e7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:37.990670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c61e6d002214f9397a3be20859dcb4e', 'request_id': 'req-9160cd6a-67bb-46ae-88cd-26c57f06e5af'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.997516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c61e6d002214f9397a3be20859dcb4e', 'request_id': 'req-9160cd6a-67bb-46ae-88cd-26c57f06e5af'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:37.998974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:38.006092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c61e6d002214f9397a3be20859dcb4e', 'request_id': 'req-9160cd6a-67bb-46ae-88cd-26c57f06e5af'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:38.013071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03360c2-2ae6-453b-8610-c10d4afd37e7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.020516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] The token cache is being invalidate because project 9c61e6d002214f9397a3be20859dcb4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:38.020811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:38.021462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9160cd6a-67bb-46ae-88cd-26c57f06e5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:38.023025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 973/1937] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:37 2022] DELETE /identity/v3/projects/9c61e6d002214f9397a3be20859dcb4e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:38.027888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd2ad1-3d84-42b2-af8e-3ed101780bfb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.028159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd2ad1-3d84-42b2-af8e-3ed101780bfb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.029055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd2ad1-3d84-42b2-af8e-3ed101780bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.040342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:38.050321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-07bd2ad1-3d84-42b2-af8e-3ed101780bfb None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:38.051555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-07bd2ad1-3d84-42b2-af8e-3ed101780bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:38.077115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.077785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.078073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.078350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.078986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.081374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.106658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 965/1938] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:37 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:23:38.110623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.114185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:38.129549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97f036-a2e4-4522-908b-ce784e5da464 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.135411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f96b9-f509-4a68-aab1-361d98d96557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.136203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f96b9-f509-4a68-aab1-361d98d96557 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.136593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f96b9-f509-4a68-aab1-361d98d96557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.136878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f96b9-f509-4a68-aab1-361d98d96557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.137567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f96b9-f509-4a68-aab1-361d98d96557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.138088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 974/1939] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:38.139396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f96b9-f509-4a68-aab1-361d98d96557 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.145873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3315b-67aa-4aeb-a647-342cca453861 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.146160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3315b-67aa-4aeb-a647-342cca453861 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.146436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3315b-67aa-4aeb-a647-342cca453861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.151028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 966/1940] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:38.156313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f96b9-f509-4a68-aab1-361d98d96557 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.167496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-73e3315b-67aa-4aeb-a647-342cca453861 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:38.168496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f96b9-f509-4a68-aab1-361d98d96557 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.168712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-73e3315b-67aa-4aeb-a647-342cca453861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:38.175180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c796-5101-4f28-a320-efb18b666e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.175867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c796-5101-4f28-a320-efb18b666e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.176160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c796-5101-4f28-a320-efb18b666e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.176442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c796-5101-4f28-a320-efb18b666e5c admin admin] PATH_INFO: `/v3/projects/c7fa36f145a64dc19315b53e33557229/users/9a94912c1e0d4598b8df437be8b22346/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.185015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 975/1941] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:38.186196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3315b-67aa-4aeb-a647-342cca453861 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.196406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3315b-67aa-4aeb-a647-342cca453861 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.197518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392c796-5101-4f28-a320-efb18b666e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fa36f145a64dc19315b53e33557229, user_id=9a94912c1e0d4598b8df437be8b22346, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.200766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392c796-5101-4f28-a320-efb18b666e5c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.203053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.203053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.203053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.203377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.203804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:38.204103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.206520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.223425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 967/1942] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:38 2022] PUT /identity/v3/projects/c7fa36f145a64dc19315b53e33557229/users/9a94912c1e0d4598b8df437be8b22346/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:38.223723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 976/1943] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:23:38.224635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c796-5101-4f28-a320-efb18b666e5c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.228199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.241848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d6dca-99f4-4551-a07a-15e1d411d6d0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.337564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c796-5101-4f28-a320-efb18b666e5c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.344090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7a744-1c47-4db3-920f-7afdb33595b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.347421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a744-1c47-4db3-920f-7afdb33595b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.347719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a744-1c47-4db3-920f-7afdb33595b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.348002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a744-1c47-4db3-920f-7afdb33595b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.352860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7a744-1c47-4db3-920f-7afdb33595b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.355604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7a744-1c47-4db3-920f-7afdb33595b2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.360247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c4516-784a-4de9-889c-4602bdfe28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.360877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c4516-784a-4de9-889c-4602bdfe28a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.361785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c4516-784a-4de9-889c-4602bdfe28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.362708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c4516-784a-4de9-889c-4602bdfe28a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.363880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c4516-784a-4de9-889c-4602bdfe28a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.365857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c4516-784a-4de9-889c-4602bdfe28a9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.377305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 968/1944] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:38.396785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7a744-1c47-4db3-920f-7afdb33595b2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.409588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 977/1945] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:38 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:38.412831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c4516-784a-4de9-889c-4602bdfe28a9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.415764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7a744-1c47-4db3-920f-7afdb33595b2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.490617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:38.509530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c4516-784a-4de9-889c-4602bdfe28a9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.522442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09da57-8308-4286-bfc1-ef53c38557f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.523250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09da57-8308-4286-bfc1-ef53c38557f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.523662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09da57-8308-4286-bfc1-ef53c38557f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.524214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09da57-8308-4286-bfc1-ef53c38557f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.525028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09da57-8308-4286-bfc1-ef53c38557f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.527734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09da57-8308-4286-bfc1-ef53c38557f1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.535972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92c18e-6e89-4ad8-acb1-dfc8a6b2ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.536486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92c18e-6e89-4ad8-acb1-dfc8a6b2ddcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.537414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92c18e-6e89-4ad8-acb1-dfc8a6b2ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.537705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92c18e-6e89-4ad8-acb1-dfc8a6b2ddcc admin admin] PATH_INFO: `/v3/projects/c7fa36f145a64dc19315b53e33557229/users/9a94912c1e0d4598b8df437be8b22346/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.543426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92c18e-6e89-4ad8-acb1-dfc8a6b2ddcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fa36f145a64dc19315b53e33557229, user_id=9a94912c1e0d4598b8df437be8b22346, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.551345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92c18e-6e89-4ad8-acb1-dfc8a6b2ddcc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.561569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 978/1946] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:38 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:38.563689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09da57-8308-4286-bfc1-ef53c38557f1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.584428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09da57-8308-4286-bfc1-ef53c38557f1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.594495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 969/1947] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:38 2022] PUT /identity/v3/projects/c7fa36f145a64dc19315b53e33557229/users/9a94912c1e0d4598b8df437be8b22346/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:38.596860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93853-f58d-48f5-9baa-b3a121ee6c33 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.597310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93853-f58d-48f5-9baa-b3a121ee6c33 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.598495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93853-f58d-48f5-9baa-b3a121ee6c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.619499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:38.643785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a3a93853-f58d-48f5-9baa-b3a121ee6c33 None None] MFA Rules not processed for user `9a94912c1e0d4598b8df437be8b22346`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:38.652459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a3a93853-f58d-48f5-9baa-b3a121ee6c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:38.707360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a66f6-cad8-45b2-8972-0d3c04b00a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.708743 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a66f6-cad8-45b2-8972-0d3c04b00a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.709185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a66f6-cad8-45b2-8972-0d3c04b00a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.709472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a66f6-cad8-45b2-8972-0d3c04b00a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.710180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a66f6-cad8-45b2-8972-0d3c04b00a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.712510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a66f6-cad8-45b2-8972-0d3c04b00a13 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.728752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 979/1948] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:38.732367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a66f6-cad8-45b2-8972-0d3c04b00a13 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.753165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 970/1949] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:38.756763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a66f6-cad8-45b2-8972-0d3c04b00a13 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.762419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dc43a-b914-4849-b1a7-1e3e9fa6792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.763035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc43a-b914-4849-b1a7-1e3e9fa6792f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.763320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc43a-b914-4849-b1a7-1e3e9fa6792f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.763596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc43a-b914-4849-b1a7-1e3e9fa6792f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.764348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dc43a-b914-4849-b1a7-1e3e9fa6792f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.765096 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a93853-f58d-48f5-9baa-b3a121ee6c33 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.765992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dc43a-b914-4849-b1a7-1e3e9fa6792f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.766701 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a3a93853-f58d-48f5-9baa-b3a121ee6c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:38.783946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 980/1950] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:38.787331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dc43a-b914-4849-b1a7-1e3e9fa6792f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.802817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dc43a-b914-4849-b1a7-1e3e9fa6792f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.808630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5d3ca-1213-440d-b8f9-db2dadedf03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.810003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d3ca-1213-440d-b8f9-db2dadedf03a admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.810573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d3ca-1213-440d-b8f9-db2dadedf03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.810998 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d3ca-1213-440d-b8f9-db2dadedf03a admin admin] PATH_INFO: `/v3/projects/4d866a0dd7a64266bbc706ff702ce8d1/users/a517a1b28e8a45d4ad50a6c0a0a7e3ea/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.840917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a93853-f58d-48f5-9baa-b3a121ee6c33 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:38.843612 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5d3ca-1213-440d-b8f9-db2dadedf03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d866a0dd7a64266bbc706ff702ce8d1, user_id=a517a1b28e8a45d4ad50a6c0a0a7e3ea, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.844813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:38.845482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.845788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.846062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.847308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5d3ca-1213-440d-b8f9-db2dadedf03a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.857319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:38.858786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:38.863161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 981/1951] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:38 2022] PUT /identity/v3/projects/4d866a0dd7a64266bbc706ff702ce8d1/users/a517a1b28e8a45d4ad50a6c0a0a7e3ea/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:38.868445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4edb4-83fc-4eba-8013-3c3fbcf9e617 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:38.868703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4edb4-83fc-4eba-8013-3c3fbcf9e617 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:38.869099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4edb4-83fc-4eba-8013-3c3fbcf9e617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:38.872750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 971/1952] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:23:38.891043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2db4edb4-83fc-4eba-8013-3c3fbcf9e617 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:38.892529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2db4edb4-83fc-4eba-8013-3c3fbcf9e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:38.984447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 982/1953] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:38.995406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:38.997226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:39.077106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755139c-1403-4bfd-9f3c-7d8b66565961 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:39.151681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11380f-c4cc-43a8-ba36-86def2d8dac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:39.152587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11380f-c4cc-43a8-ba36-86def2d8dac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:39.152931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11380f-c4cc-43a8-ba36-86def2d8dac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:39.153268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11380f-c4cc-43a8-ba36-86def2d8dac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:39.159974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:39.163975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11380f-c4cc-43a8-ba36-86def2d8dac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:39.165557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11380f-c4cc-43a8-ba36-86def2d8dac5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:39.177100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 972/1954] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:39.361927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4edb4-83fc-4eba-8013-3c3fbcf9e617 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:39.373024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4edb4-83fc-4eba-8013-3c3fbcf9e617 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:39.379270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:39.379914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:39.380238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:39.380513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] PATH_INFO: `/v3/users/e709af7aa8234be49ebd644608f2bec8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:39.381724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e709af7aa8234be49ebd644608f2bec8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:39.383670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:39.426013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:39.440979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e709af7aa8234be49ebd644608f2bec8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:39.441703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e709af7aa8234be49ebd644608f2bec8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:39.443144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e709af7aa8234be49ebd644608f2bec8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:39.461894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e709af7aa8234be49ebd644608f2bec8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:39.472220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e709af7aa8234be49ebd644608f2bec8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:39.489907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 983/1955] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:39 2022] DELETE /identity/v3/users/e709af7aa8234be49ebd644608f2bec8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:39.494277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572f1d-1c8c-45ee-9d23-6fbd7bc10925 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:39.494768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572f1d-1c8c-45ee-9d23-6fbd7bc10925 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:39.495174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572f1d-1c8c-45ee-9d23-6fbd7bc10925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:39.518978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-38572f1d-1c8c-45ee-9d23-6fbd7bc10925 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:39.520260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-38572f1d-1c8c-45ee-9d23-6fbd7bc10925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:39.614560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 973/1956] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:39.633801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:39.633801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:39.723138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce941176-bcec-477d-a526-170d1246a6c1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:39.728142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870763b7-f2ca-42c6-ae21-ce7b97e5df11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:39.728960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870763b7-f2ca-42c6-ae21-ce7b97e5df11 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:39.729365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870763b7-f2ca-42c6-ae21-ce7b97e5df11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:39.729730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870763b7-f2ca-42c6-ae21-ce7b97e5df11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:39.742648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870763b7-f2ca-42c6-ae21-ce7b97e5df11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:39.744094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870763b7-f2ca-42c6-ae21-ce7b97e5df11 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:39.758978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 984/1957] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:40.508811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572f1d-1c8c-45ee-9d23-6fbd7bc10925 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:40.511047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-38572f1d-1c8c-45ee-9d23-6fbd7bc10925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:40.570613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa51486-d9c1-4756-9061-7aa630505949 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:40.572041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa51486-d9c1-4756-9061-7aa630505949 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:40.572475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa51486-d9c1-4756-9061-7aa630505949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:40.600245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572f1d-1c8c-45ee-9d23-6fbd7bc10925 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:40.611822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:40.612976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:40.613442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:40.613926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] PATH_INFO: `/v3/projects/1912bbbc3efb4230b5030c2ee33007ee` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:40.615641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1912bbbc3efb4230b5030c2ee33007ee)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:40.618237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:40.647717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-eaa51486-d9c1-4756-9061-7aa630505949 None None] MFA Rules not processed for user `a517a1b28e8a45d4ad50a6c0a0a7e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:40.649101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eaa51486-d9c1-4756-9061-7aa630505949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:40.737993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1912bbbc3efb4230b5030c2ee33007ee', 'request_id': 'req-14e0aee4-73a8-4543-b8b1-f225fde470d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:40.749907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1912bbbc3efb4230b5030c2ee33007ee', 'request_id': 'req-14e0aee4-73a8-4543-b8b1-f225fde470d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:40.762728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1912bbbc3efb4230b5030c2ee33007ee', 'request_id': 'req-14e0aee4-73a8-4543-b8b1-f225fde470d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:40.781729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] The token cache is being invalidate because project 1912bbbc3efb4230b5030c2ee33007ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:40.783442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:40.785208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:40.791291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 974/1958] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:40 2022] DELETE /identity/v3/projects/1912bbbc3efb4230b5030c2ee33007ee => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:40.792251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:40.794834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:40.825715 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 985/1959] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:40.839824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa51486-d9c1-4756-9061-7aa630505949 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:40.841333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eaa51486-d9c1-4756-9061-7aa630505949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:40.911842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0aee4-73a8-4543-b8b1-f225fde470d6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:40.919743 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:40.926101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:40.927619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:40.927904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:40.928185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] PATH_INFO: `/v3/users/9a94912c1e0d4598b8df437be8b22346` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:40.930480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a94912c1e0d4598b8df437be8b22346)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:40.932787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:40.938052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa51486-d9c1-4756-9061-7aa630505949 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:40.997549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:41.016381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7571fb2-7744-4655-bded-f94c42bfb600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:41.021406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7571fb2-7744-4655-bded-f94c42bfb600 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:41.021862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7571fb2-7744-4655-bded-f94c42bfb600 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:41.022344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7571fb2-7744-4655-bded-f94c42bfb600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:41.076034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a94912c1e0d4598b8df437be8b22346'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:41.080331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a94912c1e0d4598b8df437be8b22346'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:41.098736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a94912c1e0d4598b8df437be8b22346'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:41.140569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a94912c1e0d4598b8df437be8b22346'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:41.150750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a94912c1e0d4598b8df437be8b22346'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:41.161554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 975/1960] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:40 2022] DELETE /identity/v3/users/9a94912c1e0d4598b8df437be8b22346 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:41.162900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7571fb2-7744-4655-bded-f94c42bfb600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:41.164754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7571fb2-7744-4655-bded-f94c42bfb600 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:41.178720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 986/1961] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:41.844596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:41.846812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:41.986887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91237a8e-7903-471b-a663-573630a419d0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:41.992063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:41.992921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:41.993402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:41.993895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] PATH_INFO: `/v3/projects/c7fa36f145a64dc19315b53e33557229` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:41.995256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fa36f145a64dc19315b53e33557229)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:41.997753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:42.055060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fa36f145a64dc19315b53e33557229', 'request_id': 'req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:42.064347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fa36f145a64dc19315b53e33557229', 'request_id': 'req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:42.074350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fa36f145a64dc19315b53e33557229', 'request_id': 'req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:42.088464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] The token cache is being invalidate because project c7fa36f145a64dc19315b53e33557229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:42.088764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:42.089430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ae71bc8-d4c8-4616-9fc9-c3ca8a3601b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:42.095860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 976/1962] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:41 2022] DELETE /identity/v3/projects/c7fa36f145a64dc19315b53e33557229 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:42.101323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3ec8-c840-4922-ad7e-b12a5da180e2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.101819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3ec8-c840-4922-ad7e-b12a5da180e2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.101819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3ec8-c840-4922-ad7e-b12a5da180e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.124755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-96de3ec8-c840-4922-ad7e-b12a5da180e2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:42.126026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-96de3ec8-c840-4922-ad7e-b12a5da180e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:42.197621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 987/1963] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:42.207337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680e305-b9df-48e6-8d99-676ae287d31c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.207696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680e305-b9df-48e6-8d99-676ae287d31c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.208282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680e305-b9df-48e6-8d99-676ae287d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.229788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6680e305-b9df-48e6-8d99-676ae287d31c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:42.230997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6680e305-b9df-48e6-8d99-676ae287d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:42.241190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 977/1964] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:42.245600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de3ec8-c840-4922-ad7e-b12a5da180e2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:42.255478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de3ec8-c840-4922-ad7e-b12a5da180e2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:42.260105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:42.260704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.260979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.261245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.261955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:42.262351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:42.264273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:42.278038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 988/1965] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:23:42.283993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680e305-b9df-48e6-8d99-676ae287d31c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:42.293813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680e305-b9df-48e6-8d99-676ae287d31c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:42.299224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fcb06-4f5f-4c49-93ae-5de2c395ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:42.299948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fcb06-4f5f-4c49-93ae-5de2c395ca4c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.300187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fcb06-4f5f-4c49-93ae-5de2c395ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.300460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fcb06-4f5f-4c49-93ae-5de2c395ca4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.301237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fcb06-4f5f-4c49-93ae-5de2c395ca4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:42.303264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fcb06-4f5f-4c49-93ae-5de2c395ca4c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:42.323700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:42.332487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 978/1966] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:42 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:42.336764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:42.347790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e078-ccec-458a-a500-6533e9b3c98e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:42.389027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:42.407259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e397c-2acb-44e2-a9e0-bc66f3f93d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:42.408684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e397c-2acb-44e2-a9e0-bc66f3f93d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.409007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e397c-2acb-44e2-a9e0-bc66f3f93d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.409279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e397c-2acb-44e2-a9e0-bc66f3f93d10 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.409976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e397c-2acb-44e2-a9e0-bc66f3f93d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:42.412062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e397c-2acb-44e2-a9e0-bc66f3f93d10 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:42.437591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 989/1967] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:42 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:42.440342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fcb06-4f5f-4c49-93ae-5de2c395ca4c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:42.450885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fcb06-4f5f-4c49-93ae-5de2c395ca4c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:42.456031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f64cb-1a26-40a2-b1a1-0621118bc4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:42.456632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f64cb-1a26-40a2-b1a1-0621118bc4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.456914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f64cb-1a26-40a2-b1a1-0621118bc4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.457212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f64cb-1a26-40a2-b1a1-0621118bc4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.457896 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f64cb-1a26-40a2-b1a1-0621118bc4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:42.459506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f64cb-1a26-40a2-b1a1-0621118bc4c8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:42.473916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 979/1968] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:42.475115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e397c-2acb-44e2-a9e0-bc66f3f93d10 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:42.484936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e397c-2acb-44e2-a9e0-bc66f3f93d10 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:42.490331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431eadd-ac68-4eb6-8ade-eff4ef73ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:42.490938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431eadd-ac68-4eb6-8ade-eff4ef73ccd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.491217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431eadd-ac68-4eb6-8ade-eff4ef73ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.491517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431eadd-ac68-4eb6-8ade-eff4ef73ccd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.492193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431eadd-ac68-4eb6-8ade-eff4ef73ccd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:42.493873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431eadd-ac68-4eb6-8ade-eff4ef73ccd5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:42.505658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 990/1969] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:42.509599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f64cb-1a26-40a2-b1a1-0621118bc4c8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:42.520047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f64cb-1a26-40a2-b1a1-0621118bc4c8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:42.524616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7eb69-ff2b-404a-b96b-064e8c861e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:42.525274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7eb69-ff2b-404a-b96b-064e8c861e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.525586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7eb69-ff2b-404a-b96b-064e8c861e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.525870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7eb69-ff2b-404a-b96b-064e8c861e2f admin admin] PATH_INFO: `/v3/projects/36d7b3322ed141d1871170fb79586389/users/0d47961c42c4495b8bd2a9405fa51f08/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.542715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7eb69-ff2b-404a-b96b-064e8c861e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d7b3322ed141d1871170fb79586389, user_id=0d47961c42c4495b8bd2a9405fa51f08, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:42.545589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7eb69-ff2b-404a-b96b-064e8c861e2f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:42.559964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 980/1970] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:42 2022] PUT /identity/v3/projects/36d7b3322ed141d1871170fb79586389/users/0d47961c42c4495b8bd2a9405fa51f08/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:42.571816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e3d2-c3a9-4628-9c6d-f328e03faa50 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.572104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e3d2-c3a9-4628-9c6d-f328e03faa50 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.572385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e3d2-c3a9-4628-9c6d-f328e03faa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.602638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d5f1e3d2-c3a9-4628-9c6d-f328e03faa50 None None] MFA Rules not processed for user `0d47961c42c4495b8bd2a9405fa51f08`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:42.603812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d5f1e3d2-c3a9-4628-9c6d-f328e03faa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:42.712495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 991/1971] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:42.713667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7eb69-ff2b-404a-b96b-064e8c861e2f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:42.757687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae83d1e-c133-4e38-b817-4937581688a2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.758002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae83d1e-c133-4e38-b817-4937581688a2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.758253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae83d1e-c133-4e38-b817-4937581688a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.798662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-dae83d1e-c133-4e38-b817-4937581688a2 None None] MFA Rules not processed for user `a517a1b28e8a45d4ad50a6c0a0a7e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:42.802142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dae83d1e-c133-4e38-b817-4937581688a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:42.840989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7eb69-ff2b-404a-b96b-064e8c861e2f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:42.849036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4b64-0740-4eae-9310-4ced074fa4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:42.855698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4b64-0740-4eae-9310-4ced074fa4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:42.856351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4b64-0740-4eae-9310-4ced074fa4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:42.856856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4b64-0740-4eae-9310-4ced074fa4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:42.858993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d4b64-0740-4eae-9310-4ced074fa4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:42.862489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d4b64-0740-4eae-9310-4ced074fa4b6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:42.911206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 981/1972] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:42 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:42.913885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4b64-0740-4eae-9310-4ced074fa4b6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:42.933851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 992/1973] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:43.003157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4b64-0740-4eae-9310-4ced074fa4b6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:43.009798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199fd3f-83c9-40b9-abed-7a9ab1ce735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:43.010847 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fd3f-83c9-40b9-abed-7a9ab1ce735b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.011278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fd3f-83c9-40b9-abed-7a9ab1ce735b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.011696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fd3f-83c9-40b9-abed-7a9ab1ce735b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.012797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199fd3f-83c9-40b9-abed-7a9ab1ce735b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:43.014965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199fd3f-83c9-40b9-abed-7a9ab1ce735b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:43.052159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 982/1974] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:42 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:43.053662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae83d1e-c133-4e38-b817-4937581688a2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:43.067086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae83d1e-c133-4e38-b817-4937581688a2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:43.072851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbef9-33aa-4447-8c86-7ceb9dddba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:43.073488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbef9-33aa-4447-8c86-7ceb9dddba96 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.073798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbef9-33aa-4447-8c86-7ceb9dddba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.074070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbef9-33aa-4447-8c86-7ceb9dddba96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.075838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cbef9-33aa-4447-8c86-7ceb9dddba96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:43.077513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cbef9-33aa-4447-8c86-7ceb9dddba96 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:43.093599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 993/1975] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:43.095903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199fd3f-83c9-40b9-abed-7a9ab1ce735b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:43.112389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199fd3f-83c9-40b9-abed-7a9ab1ce735b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:43.120459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440d9d4-c566-4e56-bf0a-1f109685b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:43.121599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440d9d4-c566-4e56-bf0a-1f109685b37b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.121599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440d9d4-c566-4e56-bf0a-1f109685b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.121779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440d9d4-c566-4e56-bf0a-1f109685b37b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.122550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440d9d4-c566-4e56-bf0a-1f109685b37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:43.124204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440d9d4-c566-4e56-bf0a-1f109685b37b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:43.143898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbef9-33aa-4447-8c86-7ceb9dddba96 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:43.153369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 983/1976] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:43.160506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbef9-33aa-4447-8c86-7ceb9dddba96 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:43.170262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db91b7-671a-4a89-b32f-ab8e147c88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:43.170967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db91b7-671a-4a89-b32f-ab8e147c88d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.171327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db91b7-671a-4a89-b32f-ab8e147c88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.171678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db91b7-671a-4a89-b32f-ab8e147c88d3 admin admin] PATH_INFO: `/v3/projects/dcd9c72df2ac4f278075031fa711ef5e/users/65cdd100da454377a075006f541650bf/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.195848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db91b7-671a-4a89-b32f-ab8e147c88d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd9c72df2ac4f278075031fa711ef5e, user_id=65cdd100da454377a075006f541650bf, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:43.199647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db91b7-671a-4a89-b32f-ab8e147c88d3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:43.231844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 994/1977] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:43 2022] PUT /identity/v3/projects/dcd9c72df2ac4f278075031fa711ef5e/users/65cdd100da454377a075006f541650bf/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:43.232916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41df70-a88d-42d3-a008-3075882233b5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.233425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41df70-a88d-42d3-a008-3075882233b5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.233950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41df70-a88d-42d3-a008-3075882233b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.269278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cb41df70-a88d-42d3-a008-3075882233b5 None None] MFA Rules not processed for user `65cdd100da454377a075006f541650bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:43.270966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cb41df70-a88d-42d3-a008-3075882233b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:43.289113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:43.364103 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 984/1978] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:43.365892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db91b7-671a-4a89-b32f-ab8e147c88d3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:43.391167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:43.462670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db91b7-671a-4a89-b32f-ab8e147c88d3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:43.472500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f1b02-eb12-4db6-b574-572c13b3c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:43.473567 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1b02-eb12-4db6-b574-572c13b3c969 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.474089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1b02-eb12-4db6-b574-572c13b3c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.474684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1b02-eb12-4db6-b574-572c13b3c969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.475551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f1b02-eb12-4db6-b574-572c13b3c969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:43.478704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f1b02-eb12-4db6-b574-572c13b3c969 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:43.521036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 995/1979] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:43 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:43.521934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41df70-a88d-42d3-a008-3075882233b5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:43.539897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41df70-a88d-42d3-a008-3075882233b5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:43.619060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541123ed-8d23-44d8-a1cc-2b573ebd0a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:43.619739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541123ed-8d23-44d8-a1cc-2b573ebd0a37 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.620030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541123ed-8d23-44d8-a1cc-2b573ebd0a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.620303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541123ed-8d23-44d8-a1cc-2b573ebd0a37 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.621275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541123ed-8d23-44d8-a1cc-2b573ebd0a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:43.622894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541123ed-8d23-44d8-a1cc-2b573ebd0a37 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:43.648697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 985/1980] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:43 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:23:43.652580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f1b02-eb12-4db6-b574-572c13b3c969 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:43.668904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f1b02-eb12-4db6-b574-572c13b3c969 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:43.675602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b61d0-e1a3-4ca1-8b1f-f7a284fe7fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:43.676556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b61d0-e1a3-4ca1-8b1f-f7a284fe7fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.676924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b61d0-e1a3-4ca1-8b1f-f7a284fe7fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.677299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b61d0-e1a3-4ca1-8b1f-f7a284fe7fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.678755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b61d0-e1a3-4ca1-8b1f-f7a284fe7fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:43.682018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b61d0-e1a3-4ca1-8b1f-f7a284fe7fd1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:43.694952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 996/1981] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:23:43.699637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541123ed-8d23-44d8-a1cc-2b573ebd0a37 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:43.714398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541123ed-8d23-44d8-a1cc-2b573ebd0a37 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:43.724173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b0eb-ecc6-48a3-a956-ddeb68adf4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:43.725072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b0eb-ecc6-48a3-a956-ddeb68adf4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:43.725682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b0eb-ecc6-48a3-a956-ddeb68adf4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:43.726322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b0eb-ecc6-48a3-a956-ddeb68adf4fd admin admin] PATH_INFO: `/v3/projects/324188f6f7fa4399a2a0ac3e91c0c398/users/2b293b074ed245919ce853e6ed13e0bc/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:43.788223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b0eb-ecc6-48a3-a956-ddeb68adf4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=324188f6f7fa4399a2a0ac3e91c0c398, user_id=2b293b074ed245919ce853e6ed13e0bc, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:43.793503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b0eb-ecc6-48a3-a956-ddeb68adf4fd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:43.825629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 986/1982] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:43 2022] PUT /identity/v3/projects/324188f6f7fa4399a2a0ac3e91c0c398/users/2b293b074ed245919ce853e6ed13e0bc/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:43.830455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b61d0-e1a3-4ca1-8b1f-f7a284fe7fd1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:43.859390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b61d0-e1a3-4ca1-8b1f-f7a284fe7fd1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:44.006352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2e513-9e3e-40f9-94a5-403b7ac609fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:44.007002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e513-9e3e-40f9-94a5-403b7ac609fd admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:44.007286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e513-9e3e-40f9-94a5-403b7ac609fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:44.007564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e513-9e3e-40f9-94a5-403b7ac609fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:44.008224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2e513-9e3e-40f9-94a5-403b7ac609fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:44.009887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2e513-9e3e-40f9-94a5-403b7ac609fd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:44.047030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 997/1983] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:44.047538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b0eb-ecc6-48a3-a956-ddeb68adf4fd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:44.072012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b0eb-ecc6-48a3-a956-ddeb68adf4fd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:44.094015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:44.094719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:44.095729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:44.095729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] PATH_INFO: `/v3/projects/324188f6f7fa4399a2a0ac3e91c0c398/users/2b293b074ed245919ce853e6ed13e0bc/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:44.098368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=324188f6f7fa4399a2a0ac3e91c0c398, user_id=2b293b074ed245919ce853e6ed13e0bc, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:44.105651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:44.149401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 987/1984] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:44 2022] PUT /identity/v3/projects/324188f6f7fa4399a2a0ac3e91c0c398/users/2b293b074ed245919ce853e6ed13e0bc/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:44.161960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137f85-f910-449f-b099-95aec64cc6f2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:44.163390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137f85-f910-449f-b099-95aec64cc6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:44.163867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69137f85-f910-449f-b099-95aec64cc6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:44.239993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-69137f85-f910-449f-b099-95aec64cc6f2 None None] MFA Rules not processed for user `2b293b074ed245919ce853e6ed13e0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:44.243038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-69137f85-f910-449f-b099-95aec64cc6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:44.386247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 998/1985] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:44.399173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:44.401133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:44.510450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6652-afe5-48df-804d-c873eea189ac admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:44.523272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:44.524009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:44.524356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:44.524703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:44.566656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:44.666643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:44.668439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:44.691106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 988/1986] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:46.596865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69137f85-f910-449f-b099-95aec64cc6f2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:46.607358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69137f85-f910-449f-b099-95aec64cc6f2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:46.611917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc571dc-1f38-4ca5-8593-232812971009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:46.613043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc571dc-1f38-4ca5-8593-232812971009 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:46.613043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc571dc-1f38-4ca5-8593-232812971009 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:46.613043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc571dc-1f38-4ca5-8593-232812971009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:46.625633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:46.696292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc571dc-1f38-4ca5-8593-232812971009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:46.697767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc571dc-1f38-4ca5-8593-232812971009 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:46.708458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 999/1987] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:47.251979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:47.253425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:47.264632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858711d2-b21f-4861-bc7d-f67edfc23df4 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:47.269388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb987693-d2df-4508-9960-5520c5d10666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:47.270056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb987693-d2df-4508-9960-5520c5d10666 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:47.270346 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb987693-d2df-4508-9960-5520c5d10666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:47.270624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb987693-d2df-4508-9960-5520c5d10666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:47.279936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb987693-d2df-4508-9960-5520c5d10666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:47.281351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb987693-d2df-4508-9960-5520c5d10666 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:47.291145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 989/1988] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:51.506357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc571dc-1f38-4ca5-8593-232812971009 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:51.571227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc571dc-1f38-4ca5-8593-232812971009 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:51.576185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:51.576821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:51.577102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:51.577374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] PATH_INFO: `/v3/users/0d47961c42c4495b8bd2a9405fa51f08` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:51.578543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d47961c42c4495b8bd2a9405fa51f08)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:51.580549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:51.630920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d47961c42c4495b8bd2a9405fa51f08'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:51.631492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d47961c42c4495b8bd2a9405fa51f08'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:51.632151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d47961c42c4495b8bd2a9405fa51f08'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:51.647042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d47961c42c4495b8bd2a9405fa51f08'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:51.656554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d47961c42c4495b8bd2a9405fa51f08'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:51.670074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1000/1989] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:51 2022] DELETE /identity/v3/users/0d47961c42c4495b8bd2a9405fa51f08 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:23:51.675946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa94d-7134-4ff8-9e65-309016846a13 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:51.676521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa94d-7134-4ff8-9e65-309016846a13 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:51.676707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa94d-7134-4ff8-9e65-309016846a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:51.700090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-98ffa94d-7134-4ff8-9e65-309016846a13 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:51.701890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98ffa94d-7134-4ff8-9e65-309016846a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:51.787467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 990/1990] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:23:51.796291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:51.797989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:51.844419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:51.870888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a374bb7-ac8e-4a1c-a876-83f6d0441fb8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:51.875422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0b320-e280-4853-bccc-783172584c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:51.876629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b320-e280-4853-bccc-783172584c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:51.876907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b320-e280-4853-bccc-783172584c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:51.877177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b320-e280-4853-bccc-783172584c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:51.887236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0b320-e280-4853-bccc-783172584c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:51.888833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0b320-e280-4853-bccc-783172584c6c service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:51.905345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1001/1991] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:23:52.259558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa94d-7134-4ff8-9e65-309016846a13 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:52.261000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98ffa94d-7134-4ff8-9e65-309016846a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:52.274539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa94d-7134-4ff8-9e65-309016846a13 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:52.279864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:52.280530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:52.280809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:52.281081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] PATH_INFO: `/v3/projects/36d7b3322ed141d1871170fb79586389` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:52.282447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d7b3322ed141d1871170fb79586389)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:52.284377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:52.331300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d7b3322ed141d1871170fb79586389', 'request_id': 'req-f6890809-f81e-491d-8470-edee357ed7f4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.338826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d7b3322ed141d1871170fb79586389', 'request_id': 'req-f6890809-f81e-491d-8470-edee357ed7f4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.345263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d7b3322ed141d1871170fb79586389', 'request_id': 'req-f6890809-f81e-491d-8470-edee357ed7f4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.356679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] The token cache is being invalidate because project 36d7b3322ed141d1871170fb79586389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:52.356972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.357679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.359162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 991/1992] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:52 2022] DELETE /identity/v3/projects/36d7b3322ed141d1871170fb79586389 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:52.363910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0b320-e280-4853-bccc-783172584c6c service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:52.373973 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0b320-e280-4853-bccc-783172584c6c service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:52.432147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:52.432781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:52.433059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:52.433329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] PATH_INFO: `/v3/users/65cdd100da454377a075006f541650bf` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:52.434473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cdd100da454377a075006f541650bf)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:52.436386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:52.483169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cdd100da454377a075006f541650bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.483809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cdd100da454377a075006f541650bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.484406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cdd100da454377a075006f541650bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.496342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cdd100da454377a075006f541650bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.506252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cdd100da454377a075006f541650bf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.521101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1002/1993] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:52 2022] DELETE /identity/v3/users/65cdd100da454377a075006f541650bf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:52.804272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:52.805838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:52.825571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6890809-f81e-491d-8470-edee357ed7f4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:52.863429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:52.896272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:52.896918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:52.897386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:52.897863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] PATH_INFO: `/v3/projects/dcd9c72df2ac4f278075031fa711ef5e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:52.899003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd9c72df2ac4f278075031fa711ef5e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:52.901041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:52.968291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd9c72df2ac4f278075031fa711ef5e', 'request_id': 'req-7296a893-74c2-43b8-ad8c-d086d283f05d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.983222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd9c72df2ac4f278075031fa711ef5e', 'request_id': 'req-7296a893-74c2-43b8-ad8c-d086d283f05d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:52.996163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd9c72df2ac4f278075031fa711ef5e', 'request_id': 'req-7296a893-74c2-43b8-ad8c-d086d283f05d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.014315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] The token cache is being invalidate because project dcd9c72df2ac4f278075031fa711ef5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:53.014741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.016078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.018731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 992/1994] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:52 2022] DELETE /identity/v3/projects/dcd9c72df2ac4f278075031fa711ef5e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:53.022632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:53.024138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:53.039903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e5618-45ac-49f3-a46c-82044bc0d7dc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:53.107532 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:53.126960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:53.128956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:53.129666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:53.130309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] PATH_INFO: `/v3/users/2b293b074ed245919ce853e6ed13e0bc` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:53.132038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b293b074ed245919ce853e6ed13e0bc)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:53.134099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:53.197474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b293b074ed245919ce853e6ed13e0bc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.198269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b293b074ed245919ce853e6ed13e0bc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.198980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b293b074ed245919ce853e6ed13e0bc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.227093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b293b074ed245919ce853e6ed13e0bc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.237253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ae6d30d3-d068-410d-9cc2-5497a1ec3e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b293b074ed245919ce853e6ed13e0bc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.254479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1003/1995] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:23:53 2022] DELETE /identity/v3/users/2b293b074ed245919ce853e6ed13e0bc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:53.538415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:53.539926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:53.553459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296a893-74c2-43b8-ad8c-d086d283f05d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:53.611711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:53.612271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:53.612557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:53.612836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] PATH_INFO: `/v3/projects/324188f6f7fa4399a2a0ac3e91c0c398` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:53.613984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] RBAC: Authorizing `identity:delete_project(project_id=324188f6f7fa4399a2a0ac3e91c0c398)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:53.615881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:53.662067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324188f6f7fa4399a2a0ac3e91c0c398', 'request_id': 'req-3b28045f-f25d-4c11-b401-486b315f463b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.669372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324188f6f7fa4399a2a0ac3e91c0c398', 'request_id': 'req-3b28045f-f25d-4c11-b401-486b315f463b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.675928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324188f6f7fa4399a2a0ac3e91c0c398', 'request_id': 'req-3b28045f-f25d-4c11-b401-486b315f463b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.677047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:53.693850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] The token cache is being invalidate because project 324188f6f7fa4399a2a0ac3e91c0c398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:23:53.694355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.695106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3b28045f-f25d-4c11-b401-486b315f463b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:23:53.696547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 993/1996] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:23:53 2022] DELETE /identity/v3/projects/324188f6f7fa4399a2a0ac3e91c0c398 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:53.701479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ef375-c342-4ddf-9bdf-599f97137adb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:53.701950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ef375-c342-4ddf-9bdf-599f97137adb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:53.702053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ef375-c342-4ddf-9bdf-599f97137adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:53.722955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2f5ef375-c342-4ddf-9bdf-599f97137adb None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:53.724190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2f5ef375-c342-4ddf-9bdf-599f97137adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:53.786406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1004/1997] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:53.794172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a8e4d-3eb6-45fa-9423-103b29dd291a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:53.794464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a8e4d-3eb6-45fa-9423-103b29dd291a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:53.794746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a8e4d-3eb6-45fa-9423-103b29dd291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:53.815450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-146a8e4d-3eb6-45fa-9423-103b29dd291a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:53.816686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-146a8e4d-3eb6-45fa-9423-103b29dd291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:53.824858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 994/1998] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:53.829507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ef375-c342-4ddf-9bdf-599f97137adb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:53.839927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ef375-c342-4ddf-9bdf-599f97137adb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:53.849718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:53.849718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:53.849718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:53.849718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:53.850099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:23:53.850099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:53.850099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:53.860932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1005/1999] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:23:53.865240 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a8e4d-3eb6-45fa-9423-103b29dd291a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:53.874569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a8e4d-3eb6-45fa-9423-103b29dd291a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:53.879996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccfc31-28de-4f0a-9224-97d63e007b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:53.880589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccfc31-28de-4f0a-9224-97d63e007b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:53.880871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccfc31-28de-4f0a-9224-97d63e007b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:53.881147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccfc31-28de-4f0a-9224-97d63e007b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:53.881825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccfc31-28de-4f0a-9224-97d63e007b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:53.883694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccfc31-28de-4f0a-9224-97d63e007b73 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:53.910401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 995/2000] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:23:53 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:53.914595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:53.925444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ab98-9308-4ba8-aa26-723e01f37316 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:53.987184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2bc45-bd80-4122-8e0a-29625796312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:53.987836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2bc45-bd80-4122-8e0a-29625796312f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:53.988112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2bc45-bd80-4122-8e0a-29625796312f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:53.988386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2bc45-bd80-4122-8e0a-29625796312f admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:53.989188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2bc45-bd80-4122-8e0a-29625796312f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:53.991489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2bc45-bd80-4122-8e0a-29625796312f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:54.000948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:23:54.016443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1006/2001] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:23:53 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:23:54.020743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccfc31-28de-4f0a-9224-97d63e007b73 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:54.032817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccfc31-28de-4f0a-9224-97d63e007b73 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:54.038128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656bbc-2e35-41c4-88f0-103749b5b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:54.038799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656bbc-2e35-41c4-88f0-103749b5b473 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:54.039084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656bbc-2e35-41c4-88f0-103749b5b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:54.039359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656bbc-2e35-41c4-88f0-103749b5b473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:54.040015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66656bbc-2e35-41c4-88f0-103749b5b473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:54.041647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66656bbc-2e35-41c4-88f0-103749b5b473 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:54.052790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 996/2002] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:54.056736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2bc45-bd80-4122-8e0a-29625796312f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:54.068062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2bc45-bd80-4122-8e0a-29625796312f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:54.076007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c26dd-c5dd-4887-9f3c-6960d9f68459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:54.076547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c26dd-c5dd-4887-9f3c-6960d9f68459 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:54.076827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c26dd-c5dd-4887-9f3c-6960d9f68459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:54.077097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c26dd-c5dd-4887-9f3c-6960d9f68459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:54.077828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c26dd-c5dd-4887-9f3c-6960d9f68459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:54.079541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c26dd-c5dd-4887-9f3c-6960d9f68459 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:54.093480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1007/2003] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:23:54.098021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656bbc-2e35-41c4-88f0-103749b5b473 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:54.108249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656bbc-2e35-41c4-88f0-103749b5b473 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:54.113718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:54.114390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:54.114675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:54.114950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] PATH_INFO: `/v3/projects/b217b4c9d4c14b6ba8f2cad713c3fe5f/users/caacd980347a4fe1bccd56d17ff8d459/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:54.131331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b217b4c9d4c14b6ba8f2cad713c3fe5f, user_id=caacd980347a4fe1bccd56d17ff8d459, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:54.134589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:54.161583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 997/2004] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:23:54 2022] PUT /identity/v3/projects/b217b4c9d4c14b6ba8f2cad713c3fe5f/users/caacd980347a4fe1bccd56d17ff8d459/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:23:54.164173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3054-0b7c-488c-ac5a-9ab4ed596c3a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:54.164482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3054-0b7c-488c-ac5a-9ab4ed596c3a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:54.164807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3054-0b7c-488c-ac5a-9ab4ed596c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:54.204381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-26fd3054-0b7c-488c-ac5a-9ab4ed596c3a None None] MFA Rules not processed for user `caacd980347a4fe1bccd56d17ff8d459`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:23:54.205635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-26fd3054-0b7c-488c-ac5a-9ab4ed596c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:54.275385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1008/2005] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:23:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:23:54.288970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:23:54.290752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:23:54.383341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f8f81-9da8-4e72-bf45-2e1e90143e7b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:23:54.389920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4810f-b08f-41a3-9624-f1248de248cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:23:54.390662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4810f-b08f-41a3-9624-f1248de248cd service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:23:54.391021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4810f-b08f-41a3-9624-f1248de248cd service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:23:54.392016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4810f-b08f-41a3-9624-f1248de248cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:23:54.402482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4810f-b08f-41a3-9624-f1248de248cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:23:54.404202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4810f-b08f-41a3-9624-f1248de248cd service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:23:54.415456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 998/2006] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:04.272580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:04.410852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=65,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:04.495498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd3054-0b7c-488c-ac5a-9ab4ed596c3a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:04.496939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-26fd3054-0b7c-488c-ac5a-9ab4ed596c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:04.562823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd3054-0b7c-488c-ac5a-9ab4ed596c3a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:04.566514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459665d-ca73-4c5f-9453-c1d1109bd00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:04.567130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459665d-ca73-4c5f-9453-c1d1109bd00e service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:04.567404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459665d-ca73-4c5f-9453-c1d1109bd00e service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:04.567672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459665d-ca73-4c5f-9453-c1d1109bd00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:04.569459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1459665d-ca73-4c5f-9453-c1d1109bd00e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:04.636264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459665d-ca73-4c5f-9453-c1d1109bd00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:04.637739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459665d-ca73-4c5f-9453-c1d1109bd00e service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:04.649119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1009/2007] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:13.759718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51ca1-7b3d-46a5-be8c-0efaa9493f0c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:13.760258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51ca1-7b3d-46a5-be8c-0efaa9493f0c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:13.760258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51ca1-7b3d-46a5-be8c-0efaa9493f0c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:13.761622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 999/2008] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:24:13.772837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989a72-afe9-427e-8f89-efc9afc6e2e4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:13.773345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989a72-afe9-427e-8f89-efc9afc6e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:13.773433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989a72-afe9-427e-8f89-efc9afc6e2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:13.795558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a6989a72-afe9-427e-8f89-efc9afc6e2e4 None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:13.796776 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a6989a72-afe9-427e-8f89-efc9afc6e2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:13.844145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51ca1-7b3d-46a5-be8c-0efaa9493f0c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:13.846832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a9a51ca1-7b3d-46a5-be8c-0efaa9493f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:13.874509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1010/2009] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:13.888072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602270b3-ad46-461c-bb33-4006185491a8 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:13.888417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602270b3-ad46-461c-bb33-4006185491a8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:13.888644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602270b3-ad46-461c-bb33-4006185491a8 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:13.890308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1011/2010] 10.222.0.15 () {54 vars in 961 bytes} [Thu Oct 6 12:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:24:13.903869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebaea4-ed4e-409c-84ce-93d7eedc967a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:13.904425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebaea4-ed4e-409c-84ce-93d7eedc967a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:13.904650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebaea4-ed4e-409c-84ce-93d7eedc967a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:13.926030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e9ebaea4-ed4e-409c-84ce-93d7eedc967a None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:13.927236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e9ebaea4-ed4e-409c-84ce-93d7eedc967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:13.930138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51ca1-7b3d-46a5-be8c-0efaa9493f0c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:13.934692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:13.935343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:13.935634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:13.936246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] PATH_INFO: `/v3/users/db1b6c3b58304f179b77be28f0be2808` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:13.937574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1b6c3b58304f179b77be28f0be2808)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:13.937981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1012/2011] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Oct 6 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:13.940212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:13.948606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebaea4-ed4e-409c-84ce-93d7eedc967a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:13.961257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebaea4-ed4e-409c-84ce-93d7eedc967a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:13.966640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39809870-5d3b-490a-8b2d-32aee5a200a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:13.967265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39809870-5d3b-490a-8b2d-32aee5a200a9 service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:13.967548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39809870-5d3b-490a-8b2d-32aee5a200a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:13.967846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39809870-5d3b-490a-8b2d-32aee5a200a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:13.977878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39809870-5d3b-490a-8b2d-32aee5a200a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:13.979576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39809870-5d3b-490a-8b2d-32aee5a200a9 service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:13.991253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1013/2012] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:24:14.012756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1b6c3b58304f179b77be28f0be2808'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.013490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1b6c3b58304f179b77be28f0be2808'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.025060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1b6c3b58304f179b77be28f0be2808'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.041497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1b6c3b58304f179b77be28f0be2808'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.050037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4f4f60e6-1a45-4452-83c1-e9c6fa1d740e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1b6c3b58304f179b77be28f0be2808'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.056725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1000/2013] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:13 2022] DELETE /identity/v3/users/db1b6c3b58304f179b77be28f0be2808 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:14.247059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39809870-5d3b-490a-8b2d-32aee5a200a9 service placement] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:14.259234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39809870-5d3b-490a-8b2d-32aee5a200a9 service placement] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:14.287752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:14.322941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:14.323563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.323841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.324111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] PATH_INFO: `/v3/projects/66a73e05a37441be908240f7aaae01ad` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.325222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a73e05a37441be908240f7aaae01ad)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:14.327180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:14.379636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a73e05a37441be908240f7aaae01ad', 'request_id': 'req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.385884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a73e05a37441be908240f7aaae01ad', 'request_id': 'req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.391493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a73e05a37441be908240f7aaae01ad', 'request_id': 'req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.405297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] The token cache is being invalidate because project 66a73e05a37441be908240f7aaae01ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:14.405615 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.406244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-9bc8cf88-29cb-4eb7-a7c1-52e41f89956c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:14.408043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1014/2014] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:14 2022] DELETE /identity/v3/projects/66a73e05a37441be908240f7aaae01ad => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:14.413426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb155-c7ae-4e6c-adaa-673f92454978 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.413840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb155-c7ae-4e6c-adaa-673f92454978 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.414173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb155-c7ae-4e6c-adaa-673f92454978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.436273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fa3bb155-c7ae-4e6c-adaa-673f92454978 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:14.437562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa3bb155-c7ae-4e6c-adaa-673f92454978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:14.517754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1001/2015] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:14.525673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056556-6a90-4f92-abde-224599136fae None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.526215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056556-6a90-4f92-abde-224599136fae None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.526493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056556-6a90-4f92-abde-224599136fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.550240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-66056556-6a90-4f92-abde-224599136fae None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:14.551666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-66056556-6a90-4f92-abde-224599136fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:14.565529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1015/2016] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:14.569800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb155-c7ae-4e6c-adaa-673f92454978 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:14.580050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb155-c7ae-4e6c-adaa-673f92454978 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:14.586130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:14.587713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.588000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.588278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.588942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:24:14.589244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:14.591313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:14.607270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1002/2017] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:24:14.611487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66056556-6a90-4f92-abde-224599136fae None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:14.623460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66056556-6a90-4f92-abde-224599136fae None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:14.635247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e268aed-a505-42b4-99a0-d8a257d9c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:14.636210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268aed-a505-42b4-99a0-d8a257d9c576 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.636656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268aed-a505-42b4-99a0-d8a257d9c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.636890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268aed-a505-42b4-99a0-d8a257d9c576 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.637846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e268aed-a505-42b4-99a0-d8a257d9c576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:14.639863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e268aed-a505-42b4-99a0-d8a257d9c576 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:14.685724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1016/2018] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:14 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:14.690872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:14.702375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148160cf-7c5e-49ad-988d-e2349d32f493 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:14.706724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:14.769597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bb39d-1c86-4ba0-bd94-97d36353032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:14.770177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb39d-1c86-4ba0-bd94-97d36353032e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.770177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb39d-1c86-4ba0-bd94-97d36353032e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.770541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb39d-1c86-4ba0-bd94-97d36353032e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.771194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bb39d-1c86-4ba0-bd94-97d36353032e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:14.773135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bb39d-1c86-4ba0-bd94-97d36353032e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:14.801827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1003/2019] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:14 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:14.806052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e268aed-a505-42b4-99a0-d8a257d9c576 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:14.817561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e268aed-a505-42b4-99a0-d8a257d9c576 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:14.822813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb14a5-8db2-49c7-8438-e0ceda1b6910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:14.823606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb14a5-8db2-49c7-8438-e0ceda1b6910 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.823892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb14a5-8db2-49c7-8438-e0ceda1b6910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.824167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb14a5-8db2-49c7-8438-e0ceda1b6910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.825104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb14a5-8db2-49c7-8438-e0ceda1b6910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:14.826752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb14a5-8db2-49c7-8438-e0ceda1b6910 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:14.840799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1017/2020] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:14.845172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bb39d-1c86-4ba0-bd94-97d36353032e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:14.855795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bb39d-1c86-4ba0-bd94-97d36353032e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:14.865154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5807-14ee-4592-8cf5-b07e05582896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:14.865934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5807-14ee-4592-8cf5-b07e05582896 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.866407 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5807-14ee-4592-8cf5-b07e05582896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.866520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5807-14ee-4592-8cf5-b07e05582896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.867282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5807-14ee-4592-8cf5-b07e05582896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:14.868890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5807-14ee-4592-8cf5-b07e05582896 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:14.881061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1004/2021] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:14.885311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb14a5-8db2-49c7-8438-e0ceda1b6910 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:14.897431 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb14a5-8db2-49c7-8438-e0ceda1b6910 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:14.903007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:14.903698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.903979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.904254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] PATH_INFO: `/v3/projects/d6da612d844c4bd3b4f30667929581c5/users/db90685082094c8f8ac7b8a12ec0f007/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.920950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6da612d844c4bd3b4f30667929581c5, user_id=db90685082094c8f8ac7b8a12ec0f007, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:14.924356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:14.937169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1018/2022] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:14 2022] PUT /identity/v3/projects/d6da612d844c4bd3b4f30667929581c5/users/db90685082094c8f8ac7b8a12ec0f007/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:14.947350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a006-10cb-402d-b074-7763c55499fc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:14.947732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a006-10cb-402d-b074-7763c55499fc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:14.948108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a006-10cb-402d-b074-7763c55499fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:14.977086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2924a006-10cb-402d-b074-7763c55499fc None None] MFA Rules not processed for user `db90685082094c8f8ac7b8a12ec0f007`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:14.978332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2924a006-10cb-402d-b074-7763c55499fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:15.046895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1005/2023] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:15.058495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:15.059977 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:15.123528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:15.151724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898cc3d-3784-43f2-982c-076bffbe9e6b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:15.157270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cac5c0-7b03-4e6f-85a3-553faccd7420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:15.158414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac5c0-7b03-4e6f-85a3-553faccd7420 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:15.158689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac5c0-7b03-4e6f-85a3-553faccd7420 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:15.158954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cac5c0-7b03-4e6f-85a3-553faccd7420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:15.166877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cac5c0-7b03-4e6f-85a3-553faccd7420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:15.168438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cac5c0-7b03-4e6f-85a3-553faccd7420 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:15.178733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1019/2024] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:16.841769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34da6-68ac-4527-b41a-632dba4cb68d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:16.842270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34da6-68ac-4527-b41a-632dba4cb68d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:16.842366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34da6-68ac-4527-b41a-632dba4cb68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:16.862595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3bb34da6-68ac-4527-b41a-632dba4cb68d None None] MFA Rules not processed for user `a517a1b28e8a45d4ad50a6c0a0a7e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:16.863968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3bb34da6-68ac-4527-b41a-632dba4cb68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:16.921042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1006/2025] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:21.669062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cac5c0-7b03-4e6f-85a3-553faccd7420 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:21.729653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cac5c0-7b03-4e6f-85a3-553faccd7420 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:21.734197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:21.734855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:21.735243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:21.735539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] PATH_INFO: `/v3/users/db90685082094c8f8ac7b8a12ec0f007` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:21.736697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db90685082094c8f8ac7b8a12ec0f007)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:21.738665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:21.790348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db90685082094c8f8ac7b8a12ec0f007'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:21.791024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db90685082094c8f8ac7b8a12ec0f007'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:21.791624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db90685082094c8f8ac7b8a12ec0f007'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:21.803754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db90685082094c8f8ac7b8a12ec0f007'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:21.811615 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db90685082094c8f8ac7b8a12ec0f007'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:21.824986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1020/2026] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:21 2022] DELETE /identity/v3/users/db90685082094c8f8ac7b8a12ec0f007 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:21.830436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a59f-dae3-4cb4-a1b3-dbb459b317de None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:21.830900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a59f-dae3-4cb4-a1b3-dbb459b317de None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:21.831000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a59f-dae3-4cb4-a1b3-dbb459b317de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:21.850459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8fa1a59f-dae3-4cb4-a1b3-dbb459b317de None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:21.853625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8fa1a59f-dae3-4cb4-a1b3-dbb459b317de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:21.866348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:21.922266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1007/2027] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:21.932767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:21.934407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:21.998810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6982d5-3948-44f4-a605-c42a898c04e2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:22.002990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef92111-c8c0-49ff-817a-f2c82f331c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:22.003725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef92111-c8c0-49ff-817a-f2c82f331c74 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.004019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef92111-c8c0-49ff-817a-f2c82f331c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.004269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef92111-c8c0-49ff-817a-f2c82f331c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.014584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef92111-c8c0-49ff-817a-f2c82f331c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:22.016013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef92111-c8c0-49ff-817a-f2c82f331c74 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:22.021517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:22.033656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1021/2028] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:22.331963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1a59f-dae3-4cb4-a1b3-dbb459b317de None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:22.333416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8fa1a59f-dae3-4cb4-a1b3-dbb459b317de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:22.345779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1a59f-dae3-4cb4-a1b3-dbb459b317de None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:22.350564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:22.351206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.351493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.351769 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] PATH_INFO: `/v3/projects/d6da612d844c4bd3b4f30667929581c5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.352958 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6da612d844c4bd3b4f30667929581c5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:22.355199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:22.408058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6da612d844c4bd3b4f30667929581c5', 'request_id': 'req-fcbbea0c-c86a-47ce-b524-fcacdad0814b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:22.421936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6da612d844c4bd3b4f30667929581c5', 'request_id': 'req-fcbbea0c-c86a-47ce-b524-fcacdad0814b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:22.428939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6da612d844c4bd3b4f30667929581c5', 'request_id': 'req-fcbbea0c-c86a-47ce-b524-fcacdad0814b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:22.440020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] The token cache is being invalidate because project d6da612d844c4bd3b4f30667929581c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:22.440312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:22.440988 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fcbbea0c-c86a-47ce-b524-fcacdad0814b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:22.442520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1008/2029] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:22 2022] DELETE /identity/v3/projects/d6da612d844c4bd3b4f30667929581c5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:22.447473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e0dc-4076-4327-80f4-a7dde2a1b065 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.447759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e0dc-4076-4327-80f4-a7dde2a1b065 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.448032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e0dc-4076-4327-80f4-a7dde2a1b065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.467791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-65b2e0dc-4076-4327-80f4-a7dde2a1b065 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:22.469011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-65b2e0dc-4076-4327-80f4-a7dde2a1b065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:22.535132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1022/2030] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:22.543947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad973c-a75b-48a6-bb9b-2c754ac6c364 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.544237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad973c-a75b-48a6-bb9b-2c754ac6c364 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.544516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad973c-a75b-48a6-bb9b-2c754ac6c364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.565164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7bad973c-a75b-48a6-bb9b-2c754ac6c364 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:22.566429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7bad973c-a75b-48a6-bb9b-2c754ac6c364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:22.574549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1009/2031] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:22.578946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2e0dc-4076-4327-80f4-a7dde2a1b065 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:22.589514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2e0dc-4076-4327-80f4-a7dde2a1b065 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:22.594230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:22.595325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.595602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.595869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.596513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:24:22.596813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:22.598701 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:22.612004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1023/2032] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:24:22.615871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad973c-a75b-48a6-bb9b-2c754ac6c364 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:22.625074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad973c-a75b-48a6-bb9b-2c754ac6c364 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:22.630277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea815-a01d-4f2d-8a64-d2fc6b2c88f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:22.630879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea815-a01d-4f2d-8a64-d2fc6b2c88f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.631164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea815-a01d-4f2d-8a64-d2fc6b2c88f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.631438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea815-a01d-4f2d-8a64-d2fc6b2c88f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.632084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea815-a01d-4f2d-8a64-d2fc6b2c88f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:22.634011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea815-a01d-4f2d-8a64-d2fc6b2c88f2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:22.663578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1010/2033] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:22 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:22.667638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:22.678632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1312947-5acc-4744-abe0-aae810457dfb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:22.734306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151c20b-56a5-48dd-a5b5-4b9f0a96ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:22.734920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151c20b-56a5-48dd-a5b5-4b9f0a96ae2a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.735331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151c20b-56a5-48dd-a5b5-4b9f0a96ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.735736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151c20b-56a5-48dd-a5b5-4b9f0a96ae2a admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.736388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151c20b-56a5-48dd-a5b5-4b9f0a96ae2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:22.738330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151c20b-56a5-48dd-a5b5-4b9f0a96ae2a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:22.759768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1024/2034] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:22 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:22.764020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea815-a01d-4f2d-8a64-d2fc6b2c88f2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:22.774778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea815-a01d-4f2d-8a64-d2fc6b2c88f2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:22.779605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846536b-3dcb-4cc0-8cc9-179561a7e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:22.780200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846536b-3dcb-4cc0-8cc9-179561a7e96d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.780484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846536b-3dcb-4cc0-8cc9-179561a7e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.780758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846536b-3dcb-4cc0-8cc9-179561a7e96d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.781426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846536b-3dcb-4cc0-8cc9-179561a7e96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:22.783192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846536b-3dcb-4cc0-8cc9-179561a7e96d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:22.792752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1011/2035] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:22.796597 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151c20b-56a5-48dd-a5b5-4b9f0a96ae2a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:22.808174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151c20b-56a5-48dd-a5b5-4b9f0a96ae2a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:22.814067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adc951-a942-4cec-a05a-0a62f8aea3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:22.815025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adc951-a942-4cec-a05a-0a62f8aea3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.815337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adc951-a942-4cec-a05a-0a62f8aea3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.815608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adc951-a942-4cec-a05a-0a62f8aea3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.816265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adc951-a942-4cec-a05a-0a62f8aea3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:22.817937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adc951-a942-4cec-a05a-0a62f8aea3c4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:22.829496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1025/2036] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:22.833576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846536b-3dcb-4cc0-8cc9-179561a7e96d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:22.844945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846536b-3dcb-4cc0-8cc9-179561a7e96d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:22.853458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19d3d2-982f-4e0c-958a-47bf58dee799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:22.854258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d3d2-982f-4e0c-958a-47bf58dee799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.854611 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d3d2-982f-4e0c-958a-47bf58dee799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.854953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d3d2-982f-4e0c-958a-47bf58dee799 admin admin] PATH_INFO: `/v3/projects/443d43cdbd1348558c747525cdc8c0b1/users/035944131dcb49d2a59af6085e2a4cb4/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.873681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19d3d2-982f-4e0c-958a-47bf58dee799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443d43cdbd1348558c747525cdc8c0b1, user_id=035944131dcb49d2a59af6085e2a4cb4, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:22.877120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19d3d2-982f-4e0c-958a-47bf58dee799 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:22.892248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1012/2037] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:22 2022] PUT /identity/v3/projects/443d43cdbd1348558c747525cdc8c0b1/users/035944131dcb49d2a59af6085e2a4cb4/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:22.902708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796e103-6493-4187-8931-9cc7b50a4046 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:22.902999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796e103-6493-4187-8931-9cc7b50a4046 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:22.903283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796e103-6493-4187-8931-9cc7b50a4046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:22.935358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6796e103-6493-4187-8931-9cc7b50a4046 None None] MFA Rules not processed for user `035944131dcb49d2a59af6085e2a4cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:22.936850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6796e103-6493-4187-8931-9cc7b50a4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:22.995004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:23.009436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1026/2038] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:23.010332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19d3d2-982f-4e0c-958a-47bf58dee799 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.054540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:23.083308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19d3d2-982f-4e0c-958a-47bf58dee799 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.088296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66545323-c6d8-4217-975e-6dcf313401bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.088919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545323-c6d8-4217-975e-6dcf313401bc admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.089211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545323-c6d8-4217-975e-6dcf313401bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.089495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545323-c6d8-4217-975e-6dcf313401bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.090169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66545323-c6d8-4217-975e-6dcf313401bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.092102 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66545323-c6d8-4217-975e-6dcf313401bc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.123144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1013/2039] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:23 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:23.128934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796e103-6493-4187-8931-9cc7b50a4046 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.141137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796e103-6493-4187-8931-9cc7b50a4046 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.217982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e669db-ab34-4c4d-b452-4bf6ead6a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.218755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e669db-ab34-4c4d-b452-4bf6ead6a6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.219042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e669db-ab34-4c4d-b452-4bf6ead6a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.219317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e669db-ab34-4c4d-b452-4bf6ead6a6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.220882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e669db-ab34-4c4d-b452-4bf6ead6a6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.224359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e669db-ab34-4c4d-b452-4bf6ead6a6b6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.248211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1027/2040] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:23 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:23.252483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66545323-c6d8-4217-975e-6dcf313401bc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.264513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66545323-c6d8-4217-975e-6dcf313401bc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.269413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12185f3d-ca65-49e2-9ef4-34bdce3e9ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.270061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12185f3d-ca65-49e2-9ef4-34bdce3e9ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.270348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12185f3d-ca65-49e2-9ef4-34bdce3e9ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.270625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12185f3d-ca65-49e2-9ef4-34bdce3e9ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.271283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12185f3d-ca65-49e2-9ef4-34bdce3e9ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.272870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12185f3d-ca65-49e2-9ef4-34bdce3e9ab0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.285938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1014/2041] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:23.289947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e669db-ab34-4c4d-b452-4bf6ead6a6b6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.301201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e669db-ab34-4c4d-b452-4bf6ead6a6b6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.305965 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177418c-e986-4951-822e-d7ef7cbe6940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.306625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177418c-e986-4951-822e-d7ef7cbe6940 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.306909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177418c-e986-4951-822e-d7ef7cbe6940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.307183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177418c-e986-4951-822e-d7ef7cbe6940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.307831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177418c-e986-4951-822e-d7ef7cbe6940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.309526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177418c-e986-4951-822e-d7ef7cbe6940 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.320377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1028/2042] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:23.324538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12185f3d-ca65-49e2-9ef4-34bdce3e9ab0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.335258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12185f3d-ca65-49e2-9ef4-34bdce3e9ab0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.340227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5be1-5ad4-48e0-a00e-b215cc59b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.340901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5be1-5ad4-48e0-a00e-b215cc59b429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.341183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5be1-5ad4-48e0-a00e-b215cc59b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.341479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5be1-5ad4-48e0-a00e-b215cc59b429 admin admin] PATH_INFO: `/v3/projects/01a274f15eaf462fb11285967757e503/users/20036d11dfd54ab5a0b33e14df4d43eb/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.357306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a5be1-5ad4-48e0-a00e-b215cc59b429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a274f15eaf462fb11285967757e503, user_id=20036d11dfd54ab5a0b33e14df4d43eb, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.362511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a5be1-5ad4-48e0-a00e-b215cc59b429 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.376808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1015/2043] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:23 2022] PUT /identity/v3/projects/01a274f15eaf462fb11285967757e503/users/20036d11dfd54ab5a0b33e14df4d43eb/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:23.387020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae87e0-e662-4ed6-a20b-8c480e8de5c4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.387367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae87e0-e662-4ed6-a20b-8c480e8de5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.387712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae87e0-e662-4ed6-a20b-8c480e8de5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.419503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d4ae87e0-e662-4ed6-a20b-8c480e8de5c4 None None] MFA Rules not processed for user `20036d11dfd54ab5a0b33e14df4d43eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:23.420714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d4ae87e0-e662-4ed6-a20b-8c480e8de5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:23.504771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1029/2044] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:23.509343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5be1-5ad4-48e0-a00e-b215cc59b429 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.580112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5be1-5ad4-48e0-a00e-b215cc59b429 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.586468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b6b6-34e3-4c9e-83f9-46f13271062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.587082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b6b6-34e3-4c9e-83f9-46f13271062a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.587362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b6b6-34e3-4c9e-83f9-46f13271062a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.587715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b6b6-34e3-4c9e-83f9-46f13271062a admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.588286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00b6b6-34e3-4c9e-83f9-46f13271062a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.590252 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00b6b6-34e3-4c9e-83f9-46f13271062a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.618481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1016/2045] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:23 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:23.622501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae87e0-e662-4ed6-a20b-8c480e8de5c4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.633203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae87e0-e662-4ed6-a20b-8c480e8de5c4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.690589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082508cd-e0fa-4ca7-99fd-752ec5e62029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.691401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082508cd-e0fa-4ca7-99fd-752ec5e62029 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.691536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082508cd-e0fa-4ca7-99fd-752ec5e62029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.691808 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082508cd-e0fa-4ca7-99fd-752ec5e62029 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.692602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082508cd-e0fa-4ca7-99fd-752ec5e62029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.694489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082508cd-e0fa-4ca7-99fd-752ec5e62029 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.705949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:23.720418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1030/2046] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:23 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:23.725742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b6b6-34e3-4c9e-83f9-46f13271062a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.736051 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b6b6-34e3-4c9e-83f9-46f13271062a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.743614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed52d-b1e2-4fa3-ac2a-74234fabe61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.744237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed52d-b1e2-4fa3-ac2a-74234fabe61a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.744557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed52d-b1e2-4fa3-ac2a-74234fabe61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.744841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed52d-b1e2-4fa3-ac2a-74234fabe61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.745583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed52d-b1e2-4fa3-ac2a-74234fabe61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.747278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed52d-b1e2-4fa3-ac2a-74234fabe61a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.758243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1017/2047] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:23.762478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082508cd-e0fa-4ca7-99fd-752ec5e62029 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.773016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082508cd-e0fa-4ca7-99fd-752ec5e62029 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.778117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69787-55d9-4c5c-a1da-b9a5a0a43adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.778777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69787-55d9-4c5c-a1da-b9a5a0a43adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.779058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69787-55d9-4c5c-a1da-b9a5a0a43adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.779333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69787-55d9-4c5c-a1da-b9a5a0a43adc admin admin] PATH_INFO: `/v3/projects/6475e3d09d904774b9c426c560fe9941/users/8d3f926e787240cda8a656afa88c260e/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.795556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a69787-55d9-4c5c-a1da-b9a5a0a43adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6475e3d09d904774b9c426c560fe9941, user_id=8d3f926e787240cda8a656afa88c260e, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.798308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a69787-55d9-4c5c-a1da-b9a5a0a43adc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.812196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1031/2048] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:23 2022] PUT /identity/v3/projects/6475e3d09d904774b9c426c560fe9941/users/8d3f926e787240cda8a656afa88c260e/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:23.816885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed52d-b1e2-4fa3-ac2a-74234fabe61a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.827931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed52d-b1e2-4fa3-ac2a-74234fabe61a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.887082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3a2a-fbe0-40bb-8f40-0acc05bc356d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.887715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3a2a-fbe0-40bb-8f40-0acc05bc356d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.887919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3a2a-fbe0-40bb-8f40-0acc05bc356d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.888197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3a2a-fbe0-40bb-8f40-0acc05bc356d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.888846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3a2a-fbe0-40bb-8f40-0acc05bc356d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.890455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3a2a-fbe0-40bb-8f40-0acc05bc356d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.896381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:23.902059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1018/2049] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:23.905858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69787-55d9-4c5c-a1da-b9a5a0a43adc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:23.917187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69787-55d9-4c5c-a1da-b9a5a0a43adc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:23.921872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:23.924319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.924607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.924878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] PATH_INFO: `/v3/projects/6475e3d09d904774b9c426c560fe9941/users/8d3f926e787240cda8a656afa88c260e/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.926829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6475e3d09d904774b9c426c560fe9941, user_id=8d3f926e787240cda8a656afa88c260e, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:23.929651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:23.941146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1032/2050] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:23 2022] PUT /identity/v3/projects/6475e3d09d904774b9c426c560fe9941/users/8d3f926e787240cda8a656afa88c260e/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:23.952277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b7e2-53d3-4af6-9a82-a91c2f7a96e8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:23.952569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b7e2-53d3-4af6-9a82-a91c2f7a96e8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:23.952847 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b7e2-53d3-4af6-9a82-a91c2f7a96e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:23.981393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bd19b7e2-53d3-4af6-9a82-a91c2f7a96e8 None None] MFA Rules not processed for user `8d3f926e787240cda8a656afa88c260e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:23.984184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bd19b7e2-53d3-4af6-9a82-a91c2f7a96e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:24.052620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1019/2051] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:24.064526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:24.066533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:24.127505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8f448-002f-4d42-85e4-2738ac4b6cb2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:24.131392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75907572-fce6-4ff1-9fd8-6cd9df5ef78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:24.132003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75907572-fce6-4ff1-9fd8-6cd9df5ef78c service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:24.132667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75907572-fce6-4ff1-9fd8-6cd9df5ef78c service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:24.132667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75907572-fce6-4ff1-9fd8-6cd9df5ef78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:24.142616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75907572-fce6-4ff1-9fd8-6cd9df5ef78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:24.144018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75907572-fce6-4ff1-9fd8-6cd9df5ef78c service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:24.154242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1033/2052] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:24.195208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b7e2-53d3-4af6-9a82-a91c2f7a96e8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:24.196572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bd19b7e2-53d3-4af6-9a82-a91c2f7a96e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:24.209279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b7e2-53d3-4af6-9a82-a91c2f7a96e8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:24.212849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1839fa9-1e4e-4bdc-b2ae-c51ecc863899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:24.213469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1839fa9-1e4e-4bdc-b2ae-c51ecc863899 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:24.213780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1839fa9-1e4e-4bdc-b2ae-c51ecc863899 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:24.214053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1839fa9-1e4e-4bdc-b2ae-c51ecc863899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:24.279826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1839fa9-1e4e-4bdc-b2ae-c51ecc863899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:24.281260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1839fa9-1e4e-4bdc-b2ae-c51ecc863899 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:24.291059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1020/2053] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:27.289225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75907572-fce6-4ff1-9fd8-6cd9df5ef78c service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:27.387549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75907572-fce6-4ff1-9fd8-6cd9df5ef78c service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:27.393148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:27.394067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:27.394368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:27.395460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] PATH_INFO: `/v3/users/035944131dcb49d2a59af6085e2a4cb4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:27.396189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=035944131dcb49d2a59af6085e2a4cb4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:27.398918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:27.475718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035944131dcb49d2a59af6085e2a4cb4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:27.476393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035944131dcb49d2a59af6085e2a4cb4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:27.477012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035944131dcb49d2a59af6085e2a4cb4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:27.493792 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035944131dcb49d2a59af6085e2a4cb4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:27.495936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:27.504985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035944131dcb49d2a59af6085e2a4cb4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:27.521872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1034/2054] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:27 2022] DELETE /identity/v3/users/035944131dcb49d2a59af6085e2a4cb4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:27.526624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf232af-2057-4767-b16f-38419d562a49 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:27.527243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf232af-2057-4767-b16f-38419d562a49 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:27.527243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf232af-2057-4767-b16f-38419d562a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:27.547065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bdf232af-2057-4767-b16f-38419d562a49 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:27.548845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bdf232af-2057-4767-b16f-38419d562a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:27.609503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1021/2055] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:27.620827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:27.622254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:27.686271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af5b7d-f0ad-4f87-b5aa-e5ba5792cff0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:27.692955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453b5cd-490f-41f9-bc7d-7fabda0d2720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:27.693655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b5cd-490f-41f9-bc7d-7fabda0d2720 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:27.693966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b5cd-490f-41f9-bc7d-7fabda0d2720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:27.694398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b5cd-490f-41f9-bc7d-7fabda0d2720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:27.705313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b5cd-490f-41f9-bc7d-7fabda0d2720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:27.706839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b5cd-490f-41f9-bc7d-7fabda0d2720 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:27.716854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1035/2056] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:28.011451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf232af-2057-4767-b16f-38419d562a49 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:28.013106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bdf232af-2057-4767-b16f-38419d562a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:28.034118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf232af-2057-4767-b16f-38419d562a49 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:28.040882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:28.041581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:28.041933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:28.042139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] PATH_INFO: `/v3/projects/443d43cdbd1348558c747525cdc8c0b1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:28.043250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443d43cdbd1348558c747525cdc8c0b1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:28.045154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:28.068328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:28.095822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443d43cdbd1348558c747525cdc8c0b1', 'request_id': 'req-1df36738-d11e-447c-a5b2-36cf32b96400'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.103608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443d43cdbd1348558c747525cdc8c0b1', 'request_id': 'req-1df36738-d11e-447c-a5b2-36cf32b96400'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.109344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443d43cdbd1348558c747525cdc8c0b1', 'request_id': 'req-1df36738-d11e-447c-a5b2-36cf32b96400'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.120614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] The token cache is being invalidate because project 443d43cdbd1348558c747525cdc8c0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:28.120906 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.121553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.123130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1022/2057] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:28 2022] DELETE /identity/v3/projects/443d43cdbd1348558c747525cdc8c0b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:28.127181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453b5cd-490f-41f9-bc7d-7fabda0d2720 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:28.137363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453b5cd-490f-41f9-bc7d-7fabda0d2720 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:28.194096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:28.194737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:28.195075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:28.195352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] PATH_INFO: `/v3/users/20036d11dfd54ab5a0b33e14df4d43eb` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:28.196501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20036d11dfd54ab5a0b33e14df4d43eb)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:28.198505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:28.247103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20036d11dfd54ab5a0b33e14df4d43eb'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.247766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20036d11dfd54ab5a0b33e14df4d43eb'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.248383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20036d11dfd54ab5a0b33e14df4d43eb'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.262207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20036d11dfd54ab5a0b33e14df4d43eb'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.270638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20036d11dfd54ab5a0b33e14df4d43eb'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.279922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:28.287042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1036/2058] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:28 2022] DELETE /identity/v3/users/20036d11dfd54ab5a0b33e14df4d43eb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:28.615207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:28.617457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:28.631768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36738-d11e-447c-a5b2-36cf32b96400 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:28.722293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:28.722961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:28.723249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:28.723530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] PATH_INFO: `/v3/projects/01a274f15eaf462fb11285967757e503` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:28.724721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a274f15eaf462fb11285967757e503)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:28.726865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:28.788969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a274f15eaf462fb11285967757e503', 'request_id': 'req-668bb347-8b5c-436a-a145-367ed867e03e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.805680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a274f15eaf462fb11285967757e503', 'request_id': 'req-668bb347-8b5c-436a-a145-367ed867e03e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.838614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a274f15eaf462fb11285967757e503', 'request_id': 'req-668bb347-8b5c-436a-a145-367ed867e03e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.858537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] The token cache is being invalidate because project 01a274f15eaf462fb11285967757e503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:28.858800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.859432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:28.861346 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1023/2059] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:28 2022] DELETE /identity/v3/projects/01a274f15eaf462fb11285967757e503 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:28.865071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:28.867541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:28.884969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820807c9-5cd8-48d7-873f-d5bad42bb2a2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:28.964104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:28.964755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:28.965167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:28.965447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] PATH_INFO: `/v3/users/8d3f926e787240cda8a656afa88c260e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:28.966818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3f926e787240cda8a656afa88c260e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:28.969142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:29.043374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3f926e787240cda8a656afa88c260e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.044722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3f926e787240cda8a656afa88c260e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.045259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3f926e787240cda8a656afa88c260e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.058620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3f926e787240cda8a656afa88c260e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.079485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d9b8df48-1c65-40bd-9c06-690a7dcc9d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3f926e787240cda8a656afa88c260e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.098387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1037/2060] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:28 2022] DELETE /identity/v3/users/8d3f926e787240cda8a656afa88c260e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:29.456520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:29.458022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:29.472098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bb347-8b5c-436a-a145-367ed867e03e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:29.506746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:29.531199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:29.532748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:29.533243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:29.533756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] PATH_INFO: `/v3/projects/6475e3d09d904774b9c426c560fe9941` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:29.535556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6475e3d09d904774b9c426c560fe9941)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:29.538076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:29.585207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6475e3d09d904774b9c426c560fe9941', 'request_id': 'req-6fe2db26-8464-4eab-9521-48e44c444fa5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.592437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6475e3d09d904774b9c426c560fe9941', 'request_id': 'req-6fe2db26-8464-4eab-9521-48e44c444fa5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.598874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6475e3d09d904774b9c426c560fe9941', 'request_id': 'req-6fe2db26-8464-4eab-9521-48e44c444fa5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.610155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] The token cache is being invalidate because project 6475e3d09d904774b9c426c560fe9941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:29.610448 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.611099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fe2db26-8464-4eab-9521-48e44c444fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:29.612827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1024/2061] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:29 2022] DELETE /identity/v3/projects/6475e3d09d904774b9c426c560fe9941 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:29.618714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12697666-4e34-4249-ba2f-be3fd39f4d70 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:29.618994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12697666-4e34-4249-ba2f-be3fd39f4d70 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:29.619303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12697666-4e34-4249-ba2f-be3fd39f4d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:29.638970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-12697666-4e34-4249-ba2f-be3fd39f4d70 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:29.640181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-12697666-4e34-4249-ba2f-be3fd39f4d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:29.699700 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1038/2062] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:29.708778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c2292-93cf-43d0-9e8d-ae681fd480a0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:29.709238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c2292-93cf-43d0-9e8d-ae681fd480a0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:29.709352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c2292-93cf-43d0-9e8d-ae681fd480a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:29.729307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2a8c2292-93cf-43d0-9e8d-ae681fd480a0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:29.730563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2a8c2292-93cf-43d0-9e8d-ae681fd480a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:29.739270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1025/2063] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:29.743620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12697666-4e34-4249-ba2f-be3fd39f4d70 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:29.754313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12697666-4e34-4249-ba2f-be3fd39f4d70 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:29.759147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:29.759745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:29.760029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:29.760303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:29.760955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:24:29.761258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:29.763030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:29.779643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1039/2064] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:24:29.780842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c2292-93cf-43d0-9e8d-ae681fd480a0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:29.790230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c2292-93cf-43d0-9e8d-ae681fd480a0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:29.795027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf695-3a99-477a-8740-ccb9bcff114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:29.795620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf695-3a99-477a-8740-ccb9bcff114b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:29.795901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf695-3a99-477a-8740-ccb9bcff114b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:29.796173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf695-3a99-477a-8740-ccb9bcff114b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:29.796801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbf695-3a99-477a-8740-ccb9bcff114b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:29.799359 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbf695-3a99-477a-8740-ccb9bcff114b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:29.830188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1026/2065] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:29 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:29.831897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:29.843687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c140e6-b255-4c2c-9e29-0eac0c151760 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:29.847335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:29.911448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d5bf-a171-44b3-9c05-8985a5563c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:29.912117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d5bf-a171-44b3-9c05-8985a5563c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:29.912389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d5bf-a171-44b3-9c05-8985a5563c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:29.912662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d5bf-a171-44b3-9c05-8985a5563c3b admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:29.913329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486d5bf-a171-44b3-9c05-8985a5563c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:29.915309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486d5bf-a171-44b3-9c05-8985a5563c3b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:29.937895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1040/2066] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:29 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:29.942068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf695-3a99-477a-8740-ccb9bcff114b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:29.952507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf695-3a99-477a-8740-ccb9bcff114b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:29.957282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e176-f63c-4af9-8b4f-92763bea52b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:29.957908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e176-f63c-4af9-8b4f-92763bea52b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:29.958198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e176-f63c-4af9-8b4f-92763bea52b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:29.958476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41e176-f63c-4af9-8b4f-92763bea52b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:29.959129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e176-f63c-4af9-8b4f-92763bea52b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:29.960729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41e176-f63c-4af9-8b4f-92763bea52b2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:29.971322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1027/2067] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:24:29.975502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d5bf-a171-44b3-9c05-8985a5563c3b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:29.986168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d5bf-a171-44b3-9c05-8985a5563c3b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:29.990879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095bb20-3279-49da-b2f0-f71aea00a1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:29.991479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095bb20-3279-49da-b2f0-f71aea00a1da admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:29.991766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095bb20-3279-49da-b2f0-f71aea00a1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:29.992045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095bb20-3279-49da-b2f0-f71aea00a1da admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:29.992693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095bb20-3279-49da-b2f0-f71aea00a1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:29.994336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095bb20-3279-49da-b2f0-f71aea00a1da admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:30.005019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1041/2068] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:30.009100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e176-f63c-4af9-8b4f-92763bea52b2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:30.021000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41e176-f63c-4af9-8b4f-92763bea52b2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:30.026181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb29f-f195-47e6-a033-32dc096f7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:30.026841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb29f-f195-47e6-a033-32dc096f7d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.027146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb29f-f195-47e6-a033-32dc096f7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.027423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb29f-f195-47e6-a033-32dc096f7d40 admin admin] PATH_INFO: `/v3/projects/3e7ff09cf46549cdae393ee01f9413db/users/cafd5284a2d54a5ea1a371786bb40999/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.045792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eb29f-f195-47e6-a033-32dc096f7d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7ff09cf46549cdae393ee01f9413db, user_id=cafd5284a2d54a5ea1a371786bb40999, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:30.049446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eb29f-f195-47e6-a033-32dc096f7d40 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:30.064478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1028/2069] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:30 2022] PUT /identity/v3/projects/3e7ff09cf46549cdae393ee01f9413db/users/cafd5284a2d54a5ea1a371786bb40999/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:30.076335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c66c-96cd-4ec8-acbb-d24c9c02d294 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.076616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c66c-96cd-4ec8-acbb-d24c9c02d294 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.076890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c66c-96cd-4ec8-acbb-d24c9c02d294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.110350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8390c66c-96cd-4ec8-acbb-d24c9c02d294 None None] MFA Rules not processed for user `cafd5284a2d54a5ea1a371786bb40999`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:30.111739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8390c66c-96cd-4ec8-acbb-d24c9c02d294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:30.186503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1042/2070] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:30.187583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb29f-f195-47e6-a033-32dc096f7d40 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:30.256745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb29f-f195-47e6-a033-32dc096f7d40 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:30.261507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fe8d-c6a9-4c1f-9083-9cf9e9925792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:30.262170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fe8d-c6a9-4c1f-9083-9cf9e9925792 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.262456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fe8d-c6a9-4c1f-9083-9cf9e9925792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.262732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fe8d-c6a9-4c1f-9083-9cf9e9925792 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.263367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fe8d-c6a9-4c1f-9083-9cf9e9925792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:30.265317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fe8d-c6a9-4c1f-9083-9cf9e9925792 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:30.276107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:30.309809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1029/2071] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:30 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:30.310843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c66c-96cd-4ec8-acbb-d24c9c02d294 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:30.323611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c66c-96cd-4ec8-acbb-d24c9c02d294 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:30.409243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f786c0-af2c-4563-9920-999369945310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:30.410230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f786c0-af2c-4563-9920-999369945310 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.410518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f786c0-af2c-4563-9920-999369945310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.410916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f786c0-af2c-4563-9920-999369945310 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.411666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f786c0-af2c-4563-9920-999369945310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:30.413742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f786c0-af2c-4563-9920-999369945310 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:30.448750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1043/2072] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:30 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:30.452450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fe8d-c6a9-4c1f-9083-9cf9e9925792 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:30.463587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fe8d-c6a9-4c1f-9083-9cf9e9925792 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:30.468585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83008-2948-4081-ae61-e7cd2db9fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:30.469943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83008-2948-4081-ae61-e7cd2db9fcdb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.470246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83008-2948-4081-ae61-e7cd2db9fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.470543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83008-2948-4081-ae61-e7cd2db9fcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.471209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83008-2948-4081-ae61-e7cd2db9fcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:30.472856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83008-2948-4081-ae61-e7cd2db9fcdb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:30.483627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1030/2073] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:30.488517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f786c0-af2c-4563-9920-999369945310 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:30.495746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:30.499599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f786c0-af2c-4563-9920-999369945310 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:30.510511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3367-cb76-4a12-adeb-c8c3acfbb4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:30.511206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3367-cb76-4a12-adeb-c8c3acfbb4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.511491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3367-cb76-4a12-adeb-c8c3acfbb4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.511773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3367-cb76-4a12-adeb-c8c3acfbb4c5 admin admin] PATH_INFO: `/v3/projects/6bc718b54b5447068f5427c8b153845a/users/7c76f6f7a63f4c239442c9c15e8e6081/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.530050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b3367-cb76-4a12-adeb-c8c3acfbb4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc718b54b5447068f5427c8b153845a, user_id=7c76f6f7a63f4c239442c9c15e8e6081, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:30.534054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b3367-cb76-4a12-adeb-c8c3acfbb4c5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:30.548796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1044/2074] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:30 2022] PUT /identity/v3/projects/6bc718b54b5447068f5427c8b153845a/users/7c76f6f7a63f4c239442c9c15e8e6081/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:30.552524 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83008-2948-4081-ae61-e7cd2db9fcdb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:30.565424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83008-2948-4081-ae61-e7cd2db9fcdb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:30.660321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc9f71-b70a-4d1f-8fea-8be34cb05432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:30.662241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc9f71-b70a-4d1f-8fea-8be34cb05432 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.662241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc9f71-b70a-4d1f-8fea-8be34cb05432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.662241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc9f71-b70a-4d1f-8fea-8be34cb05432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.662241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc9f71-b70a-4d1f-8fea-8be34cb05432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:30.664050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc9f71-b70a-4d1f-8fea-8be34cb05432 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:30.680100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1031/2075] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:30.684344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3367-cb76-4a12-adeb-c8c3acfbb4c5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:30.698554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3367-cb76-4a12-adeb-c8c3acfbb4c5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:30.704428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:30.705170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.705451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.705753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] PATH_INFO: `/v3/projects/6bc718b54b5447068f5427c8b153845a/users/7c76f6f7a63f4c239442c9c15e8e6081/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.707732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc718b54b5447068f5427c8b153845a, user_id=7c76f6f7a63f4c239442c9c15e8e6081, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:30.710417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:30.725762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1045/2076] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:30 2022] PUT /identity/v3/projects/6bc718b54b5447068f5427c8b153845a/users/7c76f6f7a63f4c239442c9c15e8e6081/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:30.738919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd02c1-2837-4da3-b526-42ce8da5d490 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.739366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd02c1-2837-4da3-b526-42ce8da5d490 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.739486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd02c1-2837-4da3-b526-42ce8da5d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.780239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-44dd02c1-2837-4da3-b526-42ce8da5d490 None None] MFA Rules not processed for user `7c76f6f7a63f4c239442c9c15e8e6081`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:30.782664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-44dd02c1-2837-4da3-b526-42ce8da5d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:30.876116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1032/2077] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:30.888361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:30.891747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:30.971493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2231e-4e5b-4b93-9347-8b41f800a005 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:30.976296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:30.977643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:30.978022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:30.978388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:30.991309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:30.993020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:31.005992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1046/2078] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:31.089829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd02c1-2837-4da3-b526-42ce8da5d490 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:31.107352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd02c1-2837-4da3-b526-42ce8da5d490 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:31.112402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:31.113178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:31.113580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:31.113952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:31.186389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:31.189764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:31.192772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:31.200596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1033/2079] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:31.369602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:31.371048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:31.452083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabaef0-ba6c-48bc-8602-bc3a9a87c16e service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:31.457513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:31.458118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:31.458630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:31.458771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] PATH_INFO: `/v3/users/9169e1bdc6354490865a75ffa906e2c6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:31.459949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9169e1bdc6354490865a75ffa906e2c6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:31.461974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:31.467718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:31.471040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:31.509797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122e80d-743a-43a6-957b-10d3a4d98f72 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:31.524188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:31.524992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:31.525591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:31.525831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] PATH_INFO: `/v3/users/caacd980347a4fe1bccd56d17ff8d459` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:31.526964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caacd980347a4fe1bccd56d17ff8d459)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:31.528881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:31.539869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9169e1bdc6354490865a75ffa906e2c6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.540537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9169e1bdc6354490865a75ffa906e2c6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.541228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9169e1bdc6354490865a75ffa906e2c6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.555786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9169e1bdc6354490865a75ffa906e2c6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.565015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9169e1bdc6354490865a75ffa906e2c6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.566890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:31.586805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1047/2080] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:31 2022] DELETE /identity/v3/users/9169e1bdc6354490865a75ffa906e2c6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:31.587691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:31.589480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:31.596033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caacd980347a4fe1bccd56d17ff8d459'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.597368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caacd980347a4fe1bccd56d17ff8d459'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.610695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caacd980347a4fe1bccd56d17ff8d459'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.626201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caacd980347a4fe1bccd56d17ff8d459'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.638672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b5d2ebc-8b27-4255-b8f7-88cd390f5503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caacd980347a4fe1bccd56d17ff8d459'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.651420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1034/2081] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:31 2022] DELETE /identity/v3/users/caacd980347a4fe1bccd56d17ff8d459 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:31.656190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a539d-3fe8-4788-ab38-19586eb8c1b7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:31.656477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a539d-3fe8-4788-ab38-19586eb8c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:31.656641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a539d-3fe8-4788-ab38-19586eb8c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:31.679502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b54a539d-3fe8-4788-ab38-19586eb8c1b7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:31.680431 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c63e-6797-455b-b967-8124048ae77a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:31.680819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b54a539d-3fe8-4788-ab38-19586eb8c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:31.759980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:31.760589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:31.760877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:31.761155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] PATH_INFO: `/v3/users/cafd5284a2d54a5ea1a371786bb40999` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:31.761840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1035/2082] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:31.762483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=cafd5284a2d54a5ea1a371786bb40999)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:31.764403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:31.775791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a539d-3fe8-4788-ab38-19586eb8c1b7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:31.777773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b54a539d-3fe8-4788-ab38-19586eb8c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:31.851603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cafd5284a2d54a5ea1a371786bb40999'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.852137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a539d-3fe8-4788-ab38-19586eb8c1b7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:31.852295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cafd5284a2d54a5ea1a371786bb40999'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.852933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cafd5284a2d54a5ea1a371786bb40999'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.856735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:31.857437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:31.857857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:31.858196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:31.860681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:31.872606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cafd5284a2d54a5ea1a371786bb40999'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.877604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:31.879529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:31.884741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-3030d783-90f2-4734-91af-0d8151dbd0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cafd5284a2d54a5ea1a371786bb40999'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:31.891838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1036/2083] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:31.892755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:31.894160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:31.904726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1048/2084] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:31 2022] DELETE /identity/v3/users/cafd5284a2d54a5ea1a371786bb40999 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:31.907179 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843f55-a831-4e02-a49c-f84739d30ee7 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:31.909639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d009-326d-4fe5-9db0-cbbdd3a29578 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:31.911350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d009-326d-4fe5-9db0-cbbdd3a29578 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:31.912063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d009-326d-4fe5-9db0-cbbdd3a29578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:31.922563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:31.940091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0d72d009-326d-4fe5-9db0-cbbdd3a29578 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:31.941308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0d72d009-326d-4fe5-9db0-cbbdd3a29578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:31.951780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:31.996123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:31.996750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:31.997105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:31.997436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] PATH_INFO: `/v3/projects/a4eff55d98d341ac87ceebdf11e5421a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:31.998702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4eff55d98d341ac87ceebdf11e5421a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:32.002381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:32.030030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1049/2085] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:32.039145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d009-326d-4fe5-9db0-cbbdd3a29578 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:32.040773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0d72d009-326d-4fe5-9db0-cbbdd3a29578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:32.086780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4eff55d98d341ac87ceebdf11e5421a', 'request_id': 'req-75b9c071-82db-4734-ba7c-e01d67f692e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.102901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4eff55d98d341ac87ceebdf11e5421a', 'request_id': 'req-75b9c071-82db-4734-ba7c-e01d67f692e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.109810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4eff55d98d341ac87ceebdf11e5421a', 'request_id': 'req-75b9c071-82db-4734-ba7c-e01d67f692e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.122920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] The token cache is being invalidate because project a4eff55d98d341ac87ceebdf11e5421a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:32.123219 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.123880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.126200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1037/2086] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:31 2022] DELETE /identity/v3/projects/a4eff55d98d341ac87ceebdf11e5421a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:32.130004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:32.130911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d009-326d-4fe5-9db0-cbbdd3a29578 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:32.131760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:32.214368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:32.214368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:32.214368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:32.214368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:32.216907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:32.224327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c071-82db-4734-ba7c-e01d67f692e3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:32.229412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:32.230091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:32.230378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:32.230657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] PATH_INFO: `/v3/users/566ad34713d54992a301e9566ec73f84` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:32.231961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=566ad34713d54992a301e9566ec73f84)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:32.234092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:32.239675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:32.241485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:32.256455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1050/2087] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:32.288340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:32.290415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566ad34713d54992a301e9566ec73f84'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.292078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566ad34713d54992a301e9566ec73f84'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.301552 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566ad34713d54992a301e9566ec73f84'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.315172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566ad34713d54992a301e9566ec73f84'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.322242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566ad34713d54992a301e9566ec73f84'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.329620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1038/2088] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:32 2022] DELETE /identity/v3/users/566ad34713d54992a301e9566ec73f84 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:32.546438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:32.548831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:32.572103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35b74-e355-4008-800d-5ac8dc5832d9 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:32.712771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:32.713575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:32.714113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:32.714325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] PATH_INFO: `/v3/projects/b217b4c9d4c14b6ba8f2cad713c3fe5f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:32.716111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b217b4c9d4c14b6ba8f2cad713c3fe5f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:32.718327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:32.740163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:32.777561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:32.779076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:32.791219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b217b4c9d4c14b6ba8f2cad713c3fe5f', 'request_id': 'req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.794703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335bde-8c40-4df0-b815-30359d86da5f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:32.802295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b217b4c9d4c14b6ba8f2cad713c3fe5f', 'request_id': 'req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.813028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b217b4c9d4c14b6ba8f2cad713c3fe5f', 'request_id': 'req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.834860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] The token cache is being invalidate because project b217b4c9d4c14b6ba8f2cad713c3fe5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:32.835162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.835813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:32.841620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1051/2089] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:32 2022] DELETE /identity/v3/projects/b217b4c9d4c14b6ba8f2cad713c3fe5f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:32.841620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:32.842060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:32.946076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37373b-f71d-4f7d-a89a-cdad4ee3fd50 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:32.950181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:32.951166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:32.951544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:32.951923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] PATH_INFO: `/v3/projects/3e7ff09cf46549cdae393ee01f9413db` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:32.953054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:32.953996 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:32.954248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7ff09cf46549cdae393ee01f9413db)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:32.954349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:32.954538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] PATH_INFO: `/v3/projects/0b710cc835ff4b8eb661e8e7dcfa920a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:32.956139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b710cc835ff4b8eb661e8e7dcfa920a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:32.957279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:32.958292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.026541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7ff09cf46549cdae393ee01f9413db', 'request_id': 'req-c45b878d-65b1-4f38-af11-96a715a02a1c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.036563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7ff09cf46549cdae393ee01f9413db', 'request_id': 'req-c45b878d-65b1-4f38-af11-96a715a02a1c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.041156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b710cc835ff4b8eb661e8e7dcfa920a', 'request_id': 'req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.046284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7ff09cf46549cdae393ee01f9413db', 'request_id': 'req-c45b878d-65b1-4f38-af11-96a715a02a1c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.049356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b710cc835ff4b8eb661e8e7dcfa920a', 'request_id': 'req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.060337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b710cc835ff4b8eb661e8e7dcfa920a', 'request_id': 'req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.061440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] The token cache is being invalidate because project 3e7ff09cf46549cdae393ee01f9413db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:33.061773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.063049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.065474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1039/2090] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:32 2022] DELETE /identity/v3/projects/3e7ff09cf46549cdae393ee01f9413db => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:33.069654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.071065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:33.077495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] The token cache is being invalidate because project 0b710cc835ff4b8eb661e8e7dcfa920a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:33.077828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.079489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc0fbcd6-08db-4068-8b8e-ff181b0ccc19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.081013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1052/2091] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:32 2022] DELETE /identity/v3/projects/0b710cc835ff4b8eb661e8e7dcfa920a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:33.085839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7143-7ec6-48d0-8178-b0fce967242c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.086129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7143-7ec6-48d0-8178-b0fce967242c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.086412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7143-7ec6-48d0-8178-b0fce967242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.115326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-264f7143-7ec6-48d0-8178-b0fce967242c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:33.116826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-264f7143-7ec6-48d0-8178-b0fce967242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:33.134260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:33.148383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b878d-65b1-4f38-af11-96a715a02a1c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.153697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:33.203094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1053/2092] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:33.212421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f248-1c65-4b1b-b474-420fb5fbeafc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.212795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f248-1c65-4b1b-b474-420fb5fbeafc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.213406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f248-1c65-4b1b-b474-420fb5fbeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.230516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.231321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.231646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.231953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] PATH_INFO: `/v3/users/7c76f6f7a63f4c239442c9c15e8e6081` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.233224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c76f6f7a63f4c239442c9c15e8e6081)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.236437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.244752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f210f248-1c65-4b1b-b474-420fb5fbeafc None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:33.246112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f210f248-1c65-4b1b-b474-420fb5fbeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:33.258421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1054/2093] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:33.263911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210f248-1c65-4b1b-b474-420fb5fbeafc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.277318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210f248-1c65-4b1b-b474-420fb5fbeafc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.287366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.287987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.288334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.288696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.289349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:24:33.289706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.291429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.305626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c76f6f7a63f4c239442c9c15e8e6081'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.306399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1055/2094] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:24:33.306751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c76f6f7a63f4c239442c9c15e8e6081'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.310592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.312843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:33.318821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c76f6f7a63f4c239442c9c15e8e6081'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.327372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af60f7-9151-484d-80e0-24b1192a7779 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.333298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ea547-d10a-4325-b0dc-bcb973a5e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.334950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ea547-d10a-4325-b0dc-bcb973a5e5cd admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.335385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ea547-d10a-4325-b0dc-bcb973a5e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.335809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ea547-d10a-4325-b0dc-bcb973a5e5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.336613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ea547-d10a-4325-b0dc-bcb973a5e5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.337018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c76f6f7a63f4c239442c9c15e8e6081'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.339496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ea547-d10a-4325-b0dc-bcb973a5e5cd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.346005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c76f6f7a63f4c239442c9c15e8e6081'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.354704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1040/2095] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:33 2022] DELETE /identity/v3/users/7c76f6f7a63f4c239442c9c15e8e6081 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:33.387584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1056/2096] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:33.392343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.478219 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5cc5-d282-4565-ab4f-0d80591637e5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.508455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:33.551693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210455-a7e6-4de1-8342-26376777ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.552538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210455-a7e6-4de1-8342-26376777ae4b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.553012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210455-a7e6-4de1-8342-26376777ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.553292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210455-a7e6-4de1-8342-26376777ae4b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.553986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68210455-a7e6-4de1-8342-26376777ae4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.555951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68210455-a7e6-4de1-8342-26376777ae4b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.581202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1041/2097] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:33.582422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ea547-d10a-4325-b0dc-bcb973a5e5cd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.592667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ea547-d10a-4325-b0dc-bcb973a5e5cd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.598344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eef31b-ca77-41ac-a422-1b1927de5bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.598947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eef31b-ca77-41ac-a422-1b1927de5bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.599234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eef31b-ca77-41ac-a422-1b1927de5bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.599625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eef31b-ca77-41ac-a422-1b1927de5bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.600277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eef31b-ca77-41ac-a422-1b1927de5bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.601918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eef31b-ca77-41ac-a422-1b1927de5bcc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.612510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1057/2098] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:24:33.616819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210455-a7e6-4de1-8342-26376777ae4b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.627231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210455-a7e6-4de1-8342-26376777ae4b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.632513 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76786f8e-9c12-40ab-ade0-48eab7d22358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.633125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76786f8e-9c12-40ab-ade0-48eab7d22358 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.633411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76786f8e-9c12-40ab-ade0-48eab7d22358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.633722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76786f8e-9c12-40ab-ade0-48eab7d22358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.634381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76786f8e-9c12-40ab-ade0-48eab7d22358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.635991 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76786f8e-9c12-40ab-ade0-48eab7d22358 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.651156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1042/2099] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:33.651765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eef31b-ca77-41ac-a422-1b1927de5bcc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.663656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eef31b-ca77-41ac-a422-1b1927de5bcc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.671456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.672525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.672525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.672748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] PATH_INFO: `/v3/projects/1d05f45c3f124a6d9263246c77929652/users/feafc45650114786a61490df8737c8e5/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.688598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d05f45c3f124a6d9263246c77929652, user_id=feafc45650114786a61490df8737c8e5, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.690819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.705561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1058/2100] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:33 2022] PUT /identity/v3/projects/1d05f45c3f124a6d9263246c77929652/users/feafc45650114786a61490df8737c8e5/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:33.715996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62890-04ac-48f5-96cb-1ced20f25cd6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.716283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62890-04ac-48f5-96cb-1ced20f25cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.716556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62890-04ac-48f5-96cb-1ced20f25cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.732451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.734199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:33.749149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eaa62890-04ac-48f5-96cb-1ced20f25cd6 None None] MFA Rules not processed for user `feafc45650114786a61490df8737c8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:33.751081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eaa62890-04ac-48f5-96cb-1ced20f25cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:33.807805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61dd82-498f-4b35-b94b-96ad60fc0f20 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.813049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.813788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.813989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.814258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] PATH_INFO: `/v3/projects/6bc718b54b5447068f5427c8b153845a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.815392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc718b54b5447068f5427c8b153845a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.817291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.819049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1043/2101] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:33.823299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa62890-04ac-48f5-96cb-1ced20f25cd6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.834469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa62890-04ac-48f5-96cb-1ced20f25cd6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.839434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84810e34-5a0e-431b-86a5-4b3ae58adb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.840036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810e34-5a0e-431b-86a5-4b3ae58adb57 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.840321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810e34-5a0e-431b-86a5-4b3ae58adb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.840589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810e34-5a0e-431b-86a5-4b3ae58adb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.841225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84810e34-5a0e-431b-86a5-4b3ae58adb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.843151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84810e34-5a0e-431b-86a5-4b3ae58adb57 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.865755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc718b54b5447068f5427c8b153845a', 'request_id': 'req-24609494-b5bc-4939-9b23-1ee59e9edeee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.873346 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1044/2102] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:33.873517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc718b54b5447068f5427c8b153845a', 'request_id': 'req-24609494-b5bc-4939-9b23-1ee59e9edeee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.874615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84810e34-5a0e-431b-86a5-4b3ae58adb57 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.878115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:33.879517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc718b54b5447068f5427c8b153845a', 'request_id': 'req-24609494-b5bc-4939-9b23-1ee59e9edeee'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.894117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] The token cache is being invalidate because project 6bc718b54b5447068f5427c8b153845a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:33.894418 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.895442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-24609494-b5bc-4939-9b23-1ee59e9edeee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:33.896986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1059/2103] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:33 2022] DELETE /identity/v3/projects/6bc718b54b5447068f5427c8b153845a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:33.902150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430466-2fa2-4cd0-a78b-4ddaaecb3ee5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.902605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430466-2fa2-4cd0-a78b-4ddaaecb3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.902885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430466-2fa2-4cd0-a78b-4ddaaecb3ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.923655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-00430466-2fa2-4cd0-a78b-4ddaaecb3ee5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:33.924862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-00430466-2fa2-4cd0-a78b-4ddaaecb3ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:33.940560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84810e34-5a0e-431b-86a5-4b3ae58adb57 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.945340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.945981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.946290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.946578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.947217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:33.949199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:33.975594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1045/2104] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:33.976717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:33.978429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:33.985652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1060/2105] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:33.985794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:33.992978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a49b46-3822-4e0b-ae73-12d1bb33fd0e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:33.993290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7ee4-259b-46fd-ae63-ab62a86a7b0d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.993603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7ee4-259b-46fd-ae63-ab62a86a7b0d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:33.993879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7ee4-259b-46fd-ae63-ab62a86a7b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:33.998788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a86ba-b9f1-41b0-803d-518ac1df57e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:33.999392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a86ba-b9f1-41b0-803d-518ac1df57e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:33.999675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a86ba-b9f1-41b0-803d-518ac1df57e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.000881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a86ba-b9f1-41b0-803d-518ac1df57e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.002210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a86ba-b9f1-41b0-803d-518ac1df57e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.003968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a86ba-b9f1-41b0-803d-518ac1df57e1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.017188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1046/2106] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:34.018803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-fe4f7ee4-259b-46fd-ae63-ab62a86a7b0d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:34.020011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fe4f7ee4-259b-46fd-ae63-ab62a86a7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:34.024864 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a86ba-b9f1-41b0-803d-518ac1df57e1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.028606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1061/2107] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:34.033391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f7ee4-259b-46fd-ae63-ab62a86a7b0d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.041258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a86ba-b9f1-41b0-803d-518ac1df57e1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.042623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f7ee4-259b-46fd-ae63-ab62a86a7b0d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.048489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6759e7a-9482-47ed-a6a4-7f09d48734ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.048655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.049099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6759e7a-9482-47ed-a6a4-7f09d48734ef admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.049260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.049376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6759e7a-9482-47ed-a6a4-7f09d48734ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.049563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.049676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6759e7a-9482-47ed-a6a4-7f09d48734ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.049849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.050316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6759e7a-9482-47ed-a6a4-7f09d48734ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.050499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:24:34.050805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.051911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6759e7a-9482-47ed-a6a4-7f09d48734ef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.052437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.063809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1047/2108] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:24:34.065581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1062/2109] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:24:34.068148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6759e7a-9482-47ed-a6a4-7f09d48734ef admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.068888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.078562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6759e7a-9482-47ed-a6a4-7f09d48734ef admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.080627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47eb51-2528-4c45-bb66-5e78160a4cf4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.084142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e13c6-c9d7-4021-883d-9d63a7dc0302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.085182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e13c6-c9d7-4021-883d-9d63a7dc0302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.085486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef4c4a-e7f2-4067-91a2-dcc1349f8be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.085745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e13c6-c9d7-4021-883d-9d63a7dc0302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.086113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4c4a-e7f2-4067-91a2-dcc1349f8be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.086241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e13c6-c9d7-4021-883d-9d63a7dc0302 admin admin] PATH_INFO: `/v3/projects/7baaedd004c94afb81cd516b33da2208/users/919beb73b0a4434daf39d66d1ba6d9b9/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.086421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4c4a-e7f2-4067-91a2-dcc1349f8be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.086655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4c4a-e7f2-4067-91a2-dcc1349f8be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.087284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef4c4a-e7f2-4067-91a2-dcc1349f8be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.089172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef4c4a-e7f2-4067-91a2-dcc1349f8be6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.106405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e13c6-c9d7-4021-883d-9d63a7dc0302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7baaedd004c94afb81cd516b33da2208, user_id=919beb73b0a4434daf39d66d1ba6d9b9, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.109062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e13c6-c9d7-4021-883d-9d63a7dc0302 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.123695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1048/2110] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:34 2022] PUT /identity/v3/projects/7baaedd004c94afb81cd516b33da2208/users/919beb73b0a4434daf39d66d1ba6d9b9/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:34.127869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1063/2111] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:34 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:34.128910 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e13c6-c9d7-4021-883d-9d63a7dc0302 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.134979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45974ddd-b199-470f-9dc7-24dedbbb54ff None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.135265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45974ddd-b199-470f-9dc7-24dedbbb54ff None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.135535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45974ddd-b199-470f-9dc7-24dedbbb54ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.165402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-45974ddd-b199-470f-9dc7-24dedbbb54ff None None] MFA Rules not processed for user `919beb73b0a4434daf39d66d1ba6d9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:34.166664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-45974ddd-b199-470f-9dc7-24dedbbb54ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:34.193223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e13c6-c9d7-4021-883d-9d63a7dc0302 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.233591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1064/2112] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:34.238266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45974ddd-b199-470f-9dc7-24dedbbb54ff None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.255726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d1dfe-eeed-4784-8b40-746e415a6756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.256334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1dfe-eeed-4784-8b40-746e415a6756 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.256618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1dfe-eeed-4784-8b40-746e415a6756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.256894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1dfe-eeed-4784-8b40-746e415a6756 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.257527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d1dfe-eeed-4784-8b40-746e415a6756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.259467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d1dfe-eeed-4784-8b40-746e415a6756 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.282258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1049/2113] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:34 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:34.286047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:34.286457 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d1dfe-eeed-4784-8b40-746e415a6756 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.296133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d1dfe-eeed-4784-8b40-746e415a6756 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.301643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e834175-624c-474d-91a9-7acbb5f3eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.302242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e834175-624c-474d-91a9-7acbb5f3eb7e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.302629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e834175-624c-474d-91a9-7acbb5f3eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.302915 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e834175-624c-474d-91a9-7acbb5f3eb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.303567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e834175-624c-474d-91a9-7acbb5f3eb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.305183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e834175-624c-474d-91a9-7acbb5f3eb7e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.311709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45974ddd-b199-470f-9dc7-24dedbbb54ff None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.315879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1050/2114] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:24:34.319296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a4c97-8850-41c9-be3b-09800b12cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.319795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e834175-624c-474d-91a9-7acbb5f3eb7e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.319894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a4c97-8850-41c9-be3b-09800b12cfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.320173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a4c97-8850-41c9-be3b-09800b12cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.320445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a4c97-8850-41c9-be3b-09800b12cfa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.321077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a4c97-8850-41c9-be3b-09800b12cfa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.323045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a4c97-8850-41c9-be3b-09800b12cfa8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.330614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e834175-624c-474d-91a9-7acbb5f3eb7e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.335335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87dc01-c33e-4e46-8350-2667d3a8ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.335922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87dc01-c33e-4e46-8350-2667d3a8ed46 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.336205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87dc01-c33e-4e46-8350-2667d3a8ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.336483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87dc01-c33e-4e46-8350-2667d3a8ed46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.337122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87dc01-c33e-4e46-8350-2667d3a8ed46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.338795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87dc01-c33e-4e46-8350-2667d3a8ed46 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.350589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1051/2115] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:24:34.352462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1065/2116] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:34 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:34.356338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a4c97-8850-41c9-be3b-09800b12cfa8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.357599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87dc01-c33e-4e46-8350-2667d3a8ed46 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.367941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87dc01-c33e-4e46-8350-2667d3a8ed46 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.404056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:34.445700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b561e-c6eb-477c-9f32-964d29d3472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.446400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b561e-c6eb-477c-9f32-964d29d3472a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.446683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b561e-c6eb-477c-9f32-964d29d3472a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.446962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b561e-c6eb-477c-9f32-964d29d3472a admin admin] PATH_INFO: `/v3/projects/e486c3d56d32462b827d18f70227a101/users/7832daf9ded94870808b42972bfa5a58/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.451299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a4c97-8850-41c9-be3b-09800b12cfa8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.457135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ace16-1543-4517-8f1d-9baad003695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.457719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace16-1543-4517-8f1d-9baad003695a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.458008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace16-1543-4517-8f1d-9baad003695a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.458284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace16-1543-4517-8f1d-9baad003695a admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.458981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ace16-1543-4517-8f1d-9baad003695a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.460999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ace16-1543-4517-8f1d-9baad003695a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.465446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b561e-c6eb-477c-9f32-964d29d3472a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e486c3d56d32462b827d18f70227a101, user_id=7832daf9ded94870808b42972bfa5a58, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.469100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b561e-c6eb-477c-9f32-964d29d3472a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.487279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1066/2118] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:34 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:34.487591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1052/2118] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:34 2022] PUT /identity/v3/projects/e486c3d56d32462b827d18f70227a101/users/7832daf9ded94870808b42972bfa5a58/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:34.498916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ace16-1543-4517-8f1d-9baad003695a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.499188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b66c-81dc-40bd-a1f2-34494709d14f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.499661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b66c-81dc-40bd-a1f2-34494709d14f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.500005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b66c-81dc-40bd-a1f2-34494709d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.511574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ace16-1543-4517-8f1d-9baad003695a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.536205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a9d3b66c-81dc-40bd-a1f2-34494709d14f None None] MFA Rules not processed for user `7832daf9ded94870808b42972bfa5a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:34.537861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a9d3b66c-81dc-40bd-a1f2-34494709d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:34.575925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b8760-2a06-428d-b806-0f99ff41c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.576549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8760-2a06-428d-b806-0f99ff41c627 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.576833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8760-2a06-428d-b806-0f99ff41c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.577160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8760-2a06-428d-b806-0f99ff41c627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.577852 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b8760-2a06-428d-b806-0f99ff41c627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.579549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b8760-2a06-428d-b806-0f99ff41c627 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.590769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1067/2119] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:34.596105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b8760-2a06-428d-b806-0f99ff41c627 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.606110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b8760-2a06-428d-b806-0f99ff41c627 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.611338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b11721-19b7-4224-a996-3d538dde11c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.611983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11721-19b7-4224-a996-3d538dde11c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.612266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11721-19b7-4224-a996-3d538dde11c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.612546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11721-19b7-4224-a996-3d538dde11c7 admin admin] PATH_INFO: `/v3/projects/01b570e354134da6a825eee9153c93db/users/01bfa3dbd0764624b66db82f25b1360d/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.620669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1053/2120] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:34.628210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b11721-19b7-4224-a996-3d538dde11c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b570e354134da6a825eee9153c93db, user_id=01bfa3dbd0764624b66db82f25b1360d, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.630938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b11721-19b7-4224-a996-3d538dde11c7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.633132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3b66c-81dc-40bd-a1f2-34494709d14f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.634504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a9d3b66c-81dc-40bd-a1f2-34494709d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:34.644723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1068/2121] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:34 2022] PUT /identity/v3/projects/01b570e354134da6a825eee9153c93db/users/01bfa3dbd0764624b66db82f25b1360d/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:34.648569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b11721-19b7-4224-a996-3d538dde11c7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.676023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:34.698861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3b66c-81dc-40bd-a1f2-34494709d14f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.719467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b11721-19b7-4224-a996-3d538dde11c7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.727675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206976cd-5f08-4bee-8643-8856a6c9f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.728413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206976cd-5f08-4bee-8643-8856a6c9f032 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.728965 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206976cd-5f08-4bee-8643-8856a6c9f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.729271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206976cd-5f08-4bee-8643-8856a6c9f032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.730163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206976cd-5f08-4bee-8643-8856a6c9f032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.732015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206976cd-5f08-4bee-8643-8856a6c9f032 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.748710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1069/2122] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:24:34.749622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206976cd-5f08-4bee-8643-8856a6c9f032 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.751699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.752508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.752888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.753258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.760246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206976cd-5f08-4bee-8643-8856a6c9f032 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:34.767343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36059aac-92c2-4ef5-8a64-55c3cdbd84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:34.768019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059aac-92c2-4ef5-8a64-55c3cdbd84e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.768298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059aac-92c2-4ef5-8a64-55c3cdbd84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.768572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059aac-92c2-4ef5-8a64-55c3cdbd84e7 admin admin] PATH_INFO: `/v3/projects/01b570e354134da6a825eee9153c93db/users/01bfa3dbd0764624b66db82f25b1360d/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.769679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:34.770555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36059aac-92c2-4ef5-8a64-55c3cdbd84e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b570e354134da6a825eee9153c93db, user_id=01bfa3dbd0764624b66db82f25b1360d, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.773250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36059aac-92c2-4ef5-8a64-55c3cdbd84e7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.786337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1070/2123] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:34 2022] PUT /identity/v3/projects/01b570e354134da6a825eee9153c93db/users/01bfa3dbd0764624b66db82f25b1360d/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:34.803328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d8b12-4311-4cd4-9457-8166bd463851 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:34.803972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d8b12-4311-4cd4-9457-8166bd463851 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:34.804435 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d8b12-4311-4cd4-9457-8166bd463851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:34.835985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:34.838547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:34.846812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-845d8b12-4311-4cd4-9457-8166bd463851 None None] MFA Rules not processed for user `01bfa3dbd0764624b66db82f25b1360d`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:34.848381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-845d8b12-4311-4cd4-9457-8166bd463851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:34.850880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1054/2124] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:24:34.930262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1071/2125] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:24:34.941740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:34.943366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:35.005373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1465-5927-4b28-b214-5cec76ecdaa2 service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:35.059006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:35.059623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:35.059915 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:35.060196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:35.061985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:35.131171 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:35.132639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:35.143566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1055/2126] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:36.757278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d8b12-4311-4cd4-9457-8166bd463851 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:36.767680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d8b12-4311-4cd4-9457-8166bd463851 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:36.771254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1234fdd-d032-4a64-96fe-1120cb61859b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:36.771840 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1234fdd-d032-4a64-96fe-1120cb61859b service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:36.772120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1234fdd-d032-4a64-96fe-1120cb61859b service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:36.772392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1234fdd-d032-4a64-96fe-1120cb61859b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:36.842091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1234fdd-d032-4a64-96fe-1120cb61859b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:36.842335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1234fdd-d032-4a64-96fe-1120cb61859b service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:36.857378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1072/2127] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:37.486485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:37.498649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71f70-5021-46a8-bcd6-8258f1571a15 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:37.503732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:37.504302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:37.504680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:37.504903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:37.516856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:37.518308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:37.529128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1056/2128] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:40.242782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3efe-9389-4bee-85f6-8132df0a00a7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:40.243285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3efe-9389-4bee-85f6-8132df0a00a7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:40.243470 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3efe-9389-4bee-85f6-8132df0a00a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:40.265653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8aeb3efe-9389-4bee-85f6-8132df0a00a7 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:40.266928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8aeb3efe-9389-4bee-85f6-8132df0a00a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:40.294950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:40.328313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1073/2129] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:40.386822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:40.388559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:40.405031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:40.465978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96afc3-f172-40d4-80a5-c0d4c343e761 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:40.471974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a8dc4-e421-436b-87e2-b1732c08a7d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:40.472586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a8dc4-e421-436b-87e2-b1732c08a7d2 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:40.472875 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a8dc4-e421-436b-87e2-b1732c08a7d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:40.473187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a8dc4-e421-436b-87e2-b1732c08a7d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:40.481709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a8dc4-e421-436b-87e2-b1732c08a7d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:40.483316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a8dc4-e421-436b-87e2-b1732c08a7d2 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:40.492670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1057/2130] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:24:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:24:41.501303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3efe-9389-4bee-85f6-8132df0a00a7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:41.601514 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3efe-9389-4bee-85f6-8132df0a00a7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:41.606663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:41.607323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:41.607599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:41.607895 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] PATH_INFO: `/v3/users/feafc45650114786a61490df8737c8e5` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:41.609754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=feafc45650114786a61490df8737c8e5)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:41.611754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:41.673737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feafc45650114786a61490df8737c8e5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:41.674560 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feafc45650114786a61490df8737c8e5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:41.675409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feafc45650114786a61490df8737c8e5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:41.697805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feafc45650114786a61490df8737c8e5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:41.710342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feafc45650114786a61490df8737c8e5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:41.733145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1074/2131] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:41 2022] DELETE /identity/v3/users/feafc45650114786a61490df8737c8e5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:41.738468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a154-1f1b-468d-8f18-756d98e931db None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:41.739378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a154-1f1b-468d-8f18-756d98e931db None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:41.739803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a154-1f1b-468d-8f18-756d98e931db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:41.767829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9b72a154-1f1b-468d-8f18-756d98e931db None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:41.769283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9b72a154-1f1b-468d-8f18-756d98e931db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:41.859306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1058/2132] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:41.869393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:41.871050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:42.017677 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cb151-1b91-464d-a7e2-63bd413e6d5b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:42.029845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcc14-2b13-4f2f-b09a-43d1b1996309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:42.031550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcc14-2b13-4f2f-b09a-43d1b1996309 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:42.032203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcc14-2b13-4f2f-b09a-43d1b1996309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:42.032481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcc14-2b13-4f2f-b09a-43d1b1996309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:42.042962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcc14-2b13-4f2f-b09a-43d1b1996309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:42.044438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcc14-2b13-4f2f-b09a-43d1b1996309 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:42.049572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:42.057962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1075/2133] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:24:42.419684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a154-1f1b-468d-8f18-756d98e931db None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:42.421254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9b72a154-1f1b-468d-8f18-756d98e931db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:42.433576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a154-1f1b-468d-8f18-756d98e931db None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:42.440893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:42.442398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:42.443107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:42.443782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] PATH_INFO: `/v3/projects/1d05f45c3f124a6d9263246c77929652` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:42.449353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d05f45c3f124a6d9263246c77929652)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:42.452376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:42.523675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d05f45c3f124a6d9263246c77929652', 'request_id': 'req-5fc59832-0f77-45c6-9d20-2b5e7396675a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.532252 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d05f45c3f124a6d9263246c77929652', 'request_id': 'req-5fc59832-0f77-45c6-9d20-2b5e7396675a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.538952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d05f45c3f124a6d9263246c77929652', 'request_id': 'req-5fc59832-0f77-45c6-9d20-2b5e7396675a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.551833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] The token cache is being invalidate because project 1d05f45c3f124a6d9263246c77929652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:42.552183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.552840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.557384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1059/2134] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:42 2022] DELETE /identity/v3/projects/1d05f45c3f124a6d9263246c77929652 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:42.558742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcc14-2b13-4f2f-b09a-43d1b1996309 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:42.571679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcc14-2b13-4f2f-b09a-43d1b1996309 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:42.649075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:42.649342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:42.649727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:42.650259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] PATH_INFO: `/v3/users/919beb73b0a4434daf39d66d1ba6d9b9` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:42.651689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919beb73b0a4434daf39d66d1ba6d9b9)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:42.654025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:42.712796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919beb73b0a4434daf39d66d1ba6d9b9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.713489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919beb73b0a4434daf39d66d1ba6d9b9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.714162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919beb73b0a4434daf39d66d1ba6d9b9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.730734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919beb73b0a4434daf39d66d1ba6d9b9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.740835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919beb73b0a4434daf39d66d1ba6d9b9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:42.755397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1076/2135] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:42 2022] DELETE /identity/v3/users/919beb73b0a4434daf39d66d1ba6d9b9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:24:43.268247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:43.270304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:43.307035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59832-0f77-45c6-9d20-2b5e7396675a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:43.341004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:43.389694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:43.390418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:43.390846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:43.391128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] PATH_INFO: `/v3/projects/7baaedd004c94afb81cd516b33da2208` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:43.392674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7baaedd004c94afb81cd516b33da2208)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:43.394793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:43.454290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7baaedd004c94afb81cd516b33da2208', 'request_id': 'req-35b01498-9254-4d37-b011-e9373c21f35d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.462962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7baaedd004c94afb81cd516b33da2208', 'request_id': 'req-35b01498-9254-4d37-b011-e9373c21f35d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.470969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7baaedd004c94afb81cd516b33da2208', 'request_id': 'req-35b01498-9254-4d37-b011-e9373c21f35d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.484203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] The token cache is being invalidate because project 7baaedd004c94afb81cd516b33da2208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:43.484572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.485249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.489767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1060/2136] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:43 2022] DELETE /identity/v3/projects/7baaedd004c94afb81cd516b33da2208 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:43.490974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:43.492871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:43.509779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711da8be-0fc9-44a9-97c0-97bc93d533b3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:43.579867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:43.580696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:43.580985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:43.581254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] PATH_INFO: `/v3/users/01bfa3dbd0764624b66db82f25b1360d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:43.582803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01bfa3dbd0764624b66db82f25b1360d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:43.584722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:43.610893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:43.648175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01bfa3dbd0764624b66db82f25b1360d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.648973 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01bfa3dbd0764624b66db82f25b1360d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.649762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01bfa3dbd0764624b66db82f25b1360d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.665012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01bfa3dbd0764624b66db82f25b1360d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.674669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-06962c75-1845-43bc-a126-d8464369b454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01bfa3dbd0764624b66db82f25b1360d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:43.689085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1077/2137] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:43 2022] DELETE /identity/v3/users/01bfa3dbd0764624b66db82f25b1360d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:44.005682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:44.007291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:44.044212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b01498-9254-4d37-b011-e9373c21f35d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:44.112251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:44.112784 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.113070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.113349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] PATH_INFO: `/v3/projects/01b570e354134da6a825eee9153c93db` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.114505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b570e354134da6a825eee9153c93db)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:44.116549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:44.179839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b570e354134da6a825eee9153c93db', 'request_id': 'req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:44.190024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b570e354134da6a825eee9153c93db', 'request_id': 'req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:44.191688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:44.199128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b570e354134da6a825eee9153c93db', 'request_id': 'req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:44.217608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] The token cache is being invalidate because project 01b570e354134da6a825eee9153c93db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:44.217608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:44.217608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e0bf1f95-296e-4cdf-a4a1-0ca306409b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:44.222177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1061/2138] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:44 2022] DELETE /identity/v3/projects/01b570e354134da6a825eee9153c93db => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:44.224294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae761b-4ddc-4858-ac58-29daf6694514 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.224703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae761b-4ddc-4858-ac58-29daf6694514 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.225053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae761b-4ddc-4858-ac58-29daf6694514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.247935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-baae761b-4ddc-4858-ac58-29daf6694514 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:44.251071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-baae761b-4ddc-4858-ac58-29daf6694514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:44.331885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1078/2139] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:44.342745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087783-030e-4f4d-9d9e-ee73529ed627 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.343886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087783-030e-4f4d-9d9e-ee73529ed627 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.343886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087783-030e-4f4d-9d9e-ee73529ed627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.377551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f5087783-030e-4f4d-9d9e-ee73529ed627 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:44.379041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f5087783-030e-4f4d-9d9e-ee73529ed627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:44.395839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1062/2140] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:44.400197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae761b-4ddc-4858-ac58-29daf6694514 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:44.416075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae761b-4ddc-4858-ac58-29daf6694514 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:44.433629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:44.434726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.435113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.435684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.436211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:24:44.436997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:44.438906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:44.455691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1079/2141] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:24:44.460150 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087783-030e-4f4d-9d9e-ee73529ed627 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:44.471013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087783-030e-4f4d-9d9e-ee73529ed627 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:44.475760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2929b-6070-4a39-93e7-74f7f0176d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:44.476421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2929b-6070-4a39-93e7-74f7f0176d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.476706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2929b-6070-4a39-93e7-74f7f0176d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.476979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2929b-6070-4a39-93e7-74f7f0176d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.477712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2929b-6070-4a39-93e7-74f7f0176d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:44.479722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2929b-6070-4a39-93e7-74f7f0176d12 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:44.520417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1063/2142] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:44 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:44.526664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:44.538656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beb0af-9990-4b98-8920-9d221f774d1e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:44.664392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36a0a6-082d-4591-a51c-e4846f5ae1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:44.665207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36a0a6-082d-4591-a51c-e4846f5ae1fb admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.665458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36a0a6-082d-4591-a51c-e4846f5ae1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.665690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36a0a6-082d-4591-a51c-e4846f5ae1fb admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.666359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36a0a6-082d-4591-a51c-e4846f5ae1fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:44.668536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36a0a6-082d-4591-a51c-e4846f5ae1fb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:44.694035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1080/2143] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:44 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:44.698143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2929b-6070-4a39-93e7-74f7f0176d12 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:44.717717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2929b-6070-4a39-93e7-74f7f0176d12 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:44.723758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dd1de-6683-4bb2-b029-a3457d8c7fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:44.724613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dd1de-6683-4bb2-b029-a3457d8c7fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.725064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dd1de-6683-4bb2-b029-a3457d8c7fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.725467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dd1de-6683-4bb2-b029-a3457d8c7fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.726329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dd1de-6683-4bb2-b029-a3457d8c7fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:44.728191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dd1de-6683-4bb2-b029-a3457d8c7fe0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:44.742428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1064/2144] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:44.746375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36a0a6-082d-4591-a51c-e4846f5ae1fb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:44.763160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36a0a6-082d-4591-a51c-e4846f5ae1fb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:44.768898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d0471-bec2-4db2-acf9-c2da91921725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:44.769619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d0471-bec2-4db2-acf9-c2da91921725 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.769936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d0471-bec2-4db2-acf9-c2da91921725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.770238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d0471-bec2-4db2-acf9-c2da91921725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.770974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d0471-bec2-4db2-acf9-c2da91921725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:44.772784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d0471-bec2-4db2-acf9-c2da91921725 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:44.786612 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1081/2145] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:44.791348 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dd1de-6683-4bb2-b029-a3457d8c7fe0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:44.804719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dd1de-6683-4bb2-b029-a3457d8c7fe0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:44.810851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:44.812210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.812658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.812986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] PATH_INFO: `/v3/projects/0e2f68c5589a48f291f2ab5288b3c9de/users/2bc508cb96904a39a00d5503c401a775/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.831331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2f68c5589a48f291f2ab5288b3c9de, user_id=2bc508cb96904a39a00d5503c401a775, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:44.837801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:44.856019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1065/2146] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:44 2022] PUT /identity/v3/projects/0e2f68c5589a48f291f2ab5288b3c9de/users/2bc508cb96904a39a00d5503c401a775/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:44.866570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b26d0-5707-4e1c-8849-75bfc6a764ac None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:44.866835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b26d0-5707-4e1c-8849-75bfc6a764ac None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:44.867476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b26d0-5707-4e1c-8849-75bfc6a764ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:44.875228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:44.909617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-035b26d0-5707-4e1c-8849-75bfc6a764ac None None] MFA Rules not processed for user `2bc508cb96904a39a00d5503c401a775`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:44.911074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-035b26d0-5707-4e1c-8849-75bfc6a764ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:45.003909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1082/2147] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:45.016093 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:45.018151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:45.104675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe8a3-cc22-4520-aec8-347d44933050 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:45.109299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9326f-f853-408f-91a6-22b2f0da3322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:45.110027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9326f-f853-408f-91a6-22b2f0da3322 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:45.110489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9326f-f853-408f-91a6-22b2f0da3322 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:45.110836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9326f-f853-408f-91a6-22b2f0da3322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:45.120410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9326f-f853-408f-91a6-22b2f0da3322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:45.121974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9326f-f853-408f-91a6-22b2f0da3322 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:45.132881 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1066/2148] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:45.159286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b26d0-5707-4e1c-8849-75bfc6a764ac None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:45.232007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b26d0-5707-4e1c-8849-75bfc6a764ac None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:45.237303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:45.238009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:45.238289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:45.238607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] PATH_INFO: `/v3/users/2bc508cb96904a39a00d5503c401a775` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:45.239823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc508cb96904a39a00d5503c401a775)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:45.242058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:45.300040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc508cb96904a39a00d5503c401a775'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:45.300790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc508cb96904a39a00d5503c401a775'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:45.301432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc508cb96904a39a00d5503c401a775'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:45.317911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc508cb96904a39a00d5503c401a775'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:45.327559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc508cb96904a39a00d5503c401a775'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:45.342113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1083/2149] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:45 2022] DELETE /identity/v3/users/2bc508cb96904a39a00d5503c401a775 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:45.347649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25a85-9fb3-4795-824d-b0c568423ebe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:45.348214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25a85-9fb3-4795-824d-b0c568423ebe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:45.348372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25a85-9fb3-4795-824d-b0c568423ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:45.371014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cfd25a85-9fb3-4795-824d-b0c568423ebe None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:45.372243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cfd25a85-9fb3-4795-824d-b0c568423ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:45.443531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1067/2150] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:45.453562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:45.455107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:45.471136 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:45.529343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d911b0-f582-4379-bc82-2b9354a431cf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:45.534293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1930ac-5071-4b62-99e5-bbcc91227622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:45.538082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1930ac-5071-4b62-99e5-bbcc91227622 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:45.539406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1930ac-5071-4b62-99e5-bbcc91227622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:45.539832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1930ac-5071-4b62-99e5-bbcc91227622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:45.553511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1930ac-5071-4b62-99e5-bbcc91227622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:45.555246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1930ac-5071-4b62-99e5-bbcc91227622 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:45.567380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1084/2151] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:45.912179 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25a85-9fb3-4795-824d-b0c568423ebe None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:45.914132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cfd25a85-9fb3-4795-824d-b0c568423ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:45.946982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25a85-9fb3-4795-824d-b0c568423ebe None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:45.953830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:45.954562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:45.954895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:45.955173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] PATH_INFO: `/v3/projects/0e2f68c5589a48f291f2ab5288b3c9de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:45.956375 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2f68c5589a48f291f2ab5288b3c9de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:45.958545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:45.985433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:46.022286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2f68c5589a48f291f2ab5288b3c9de', 'request_id': 'req-78d47e84-9b22-4dcf-8c54-2f6706871822'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:46.034478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2f68c5589a48f291f2ab5288b3c9de', 'request_id': 'req-78d47e84-9b22-4dcf-8c54-2f6706871822'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:46.041658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2f68c5589a48f291f2ab5288b3c9de', 'request_id': 'req-78d47e84-9b22-4dcf-8c54-2f6706871822'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:46.056019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] The token cache is being invalidate because project 0e2f68c5589a48f291f2ab5288b3c9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:46.056341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:46.057065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-78d47e84-9b22-4dcf-8c54-2f6706871822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:46.058774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1068/2152] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:45 2022] DELETE /identity/v3/projects/0e2f68c5589a48f291f2ab5288b3c9de => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:46.064991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ddb6-fc9c-42db-85d7-5a6c4de14f2d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.065511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ddb6-fc9c-42db-85d7-5a6c4de14f2d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.065650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ddb6-fc9c-42db-85d7-5a6c4de14f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.089353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f6a0ddb6-fc9c-42db-85d7-5a6c4de14f2d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:46.090754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f6a0ddb6-fc9c-42db-85d7-5a6c4de14f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:46.199758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1085/2153] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:46.208382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2263c62-7940-4505-9f66-66ef129d039b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.208711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2263c62-7940-4505-9f66-66ef129d039b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.209025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2263c62-7940-4505-9f66-66ef129d039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.232274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b2263c62-7940-4505-9f66-66ef129d039b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:46.233817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b2263c62-7940-4505-9f66-66ef129d039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:46.242516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1069/2154] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:46.246828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0ddb6-fc9c-42db-85d7-5a6c4de14f2d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:46.257794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0ddb6-fc9c-42db-85d7-5a6c4de14f2d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:46.262491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:46.263124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.263403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.263677 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.264325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:24:46.265287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:46.267301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:46.280156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1086/2155] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:24:46.285774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2263c62-7940-4505-9f66-66ef129d039b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:46.301300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2263c62-7940-4505-9f66-66ef129d039b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:46.307662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60320-d23b-43cb-9d56-c11738922d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:46.308410 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60320-d23b-43cb-9d56-c11738922d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.308698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60320-d23b-43cb-9d56-c11738922d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.308967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60320-d23b-43cb-9d56-c11738922d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.309918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf60320-d23b-43cb-9d56-c11738922d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:46.312520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf60320-d23b-43cb-9d56-c11738922d39 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:46.349565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1070/2156] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:24:46 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:24:46.352827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:46.377320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61a00b-c633-4258-8975-9d592e4cd7b7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:46.456836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74f2c9-ca1f-4d11-961f-b6a113fa6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:46.457643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f2c9-ca1f-4d11-961f-b6a113fa6be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.457989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f2c9-ca1f-4d11-961f-b6a113fa6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.458306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f2c9-ca1f-4d11-961f-b6a113fa6be5 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.459017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74f2c9-ca1f-4d11-961f-b6a113fa6be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:46.461044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74f2c9-ca1f-4d11-961f-b6a113fa6be5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:46.487821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1087/2157] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:24:46 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:24:46.492270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60320-d23b-43cb-9d56-c11738922d39 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:46.509727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60320-d23b-43cb-9d56-c11738922d39 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:46.516338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d981-e9cc-4eba-9b55-ac3dde7c02cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:46.516949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d981-e9cc-4eba-9b55-ac3dde7c02cb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.517285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d981-e9cc-4eba-9b55-ac3dde7c02cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.517836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d981-e9cc-4eba-9b55-ac3dde7c02cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.518400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25d981-e9cc-4eba-9b55-ac3dde7c02cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:46.520404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25d981-e9cc-4eba-9b55-ac3dde7c02cb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:46.533525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1071/2158] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:46.537651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74f2c9-ca1f-4d11-961f-b6a113fa6be5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:46.549623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74f2c9-ca1f-4d11-961f-b6a113fa6be5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:46.555170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9dd45-1839-4df9-a409-4b6c2ae1a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:46.555944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9dd45-1839-4df9-a409-4b6c2ae1a0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.556246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9dd45-1839-4df9-a409-4b6c2ae1a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.556529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9dd45-1839-4df9-a409-4b6c2ae1a0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.557289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9dd45-1839-4df9-a409-4b6c2ae1a0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:46.559034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9dd45-1839-4df9-a409-4b6c2ae1a0ba admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:46.571255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1088/2159] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:24:46.575515 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d981-e9cc-4eba-9b55-ac3dde7c02cb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:46.586441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d981-e9cc-4eba-9b55-ac3dde7c02cb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:46.591753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:46.592475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.593326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.593667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] PATH_INFO: `/v3/projects/34d5800860f1435dbb7400eb7a016976/users/9fe5dfa06ea04c748c1a0cc8de3a2806/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.614696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d5800860f1435dbb7400eb7a016976, user_id=9fe5dfa06ea04c748c1a0cc8de3a2806, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:46.617579 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:46.634121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1072/2160] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:24:46 2022] PUT /identity/v3/projects/34d5800860f1435dbb7400eb7a016976/users/9fe5dfa06ea04c748c1a0cc8de3a2806/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:46.645770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1c356-1cc8-4022-861e-417411f7f3f7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.646174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1c356-1cc8-4022-861e-417411f7f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.646456 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1c356-1cc8-4022-861e-417411f7f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.687044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-42c1c356-1cc8-4022-861e-417411f7f3f7 None None] MFA Rules not processed for user `9fe5dfa06ea04c748c1a0cc8de3a2806`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:46.689561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-42c1c356-1cc8-4022-861e-417411f7f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:46.701981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:46.807247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1089/2161] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:46.818972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:46.820998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:46.917045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ac0b-015d-4fe8-85d4-74eeeea4fadd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:46.922308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33fb2e-05e5-4e5d-87fc-a3d1ee60972f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:46.922545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fb2e-05e5-4e5d-87fc-a3d1ee60972f service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:46.922841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fb2e-05e5-4e5d-87fc-a3d1ee60972f service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:46.923189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fb2e-05e5-4e5d-87fc-a3d1ee60972f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:46.941710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33fb2e-05e5-4e5d-87fc-a3d1ee60972f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:46.943794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33fb2e-05e5-4e5d-87fc-a3d1ee60972f service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:46.955267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1073/2162] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:24:52.184848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1c356-1cc8-4022-861e-417411f7f3f7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:52.285986 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1c356-1cc8-4022-861e-417411f7f3f7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:52.292553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:52.293837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:52.294253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:52.294669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] PATH_INFO: `/v3/users/9fe5dfa06ea04c748c1a0cc8de3a2806` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:52.296899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe5dfa06ea04c748c1a0cc8de3a2806)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:52.299768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:52.362771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe5dfa06ea04c748c1a0cc8de3a2806'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:52.363460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe5dfa06ea04c748c1a0cc8de3a2806'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:52.364318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe5dfa06ea04c748c1a0cc8de3a2806'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:52.379961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe5dfa06ea04c748c1a0cc8de3a2806'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:52.388524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe5dfa06ea04c748c1a0cc8de3a2806'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:52.409004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbbe73-5067-4f5b-bc7d-fa4cd7218e54 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:52.409671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbbe73-5067-4f5b-bc7d-fa4cd7218e54 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:52.409671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbbe73-5067-4f5b-bc7d-fa4cd7218e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:52.413649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1090/2163] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:24:52 2022] DELETE /identity/v3/users/9fe5dfa06ea04c748c1a0cc8de3a2806 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:24:52.433746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-abdbbe73-5067-4f5b-bc7d-fa4cd7218e54 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:24:52.435871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-abdbbe73-5067-4f5b-bc7d-fa4cd7218e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:52.488533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:52.527927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1074/2164] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:24:52.528779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:52.530444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:52.584970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:24:52.621866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b66e4-f68c-4c80-8f3f-e355f0b2d2e9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:52.626443 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a9b54-4524-4354-bc1b-33de8239e566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:52.627063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a9b54-4524-4354-bc1b-33de8239e566 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:52.627345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a9b54-4524-4354-bc1b-33de8239e566 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:52.627617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a9b54-4524-4354-bc1b-33de8239e566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:52.638244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a9b54-4524-4354-bc1b-33de8239e566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:52.641020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a9b54-4524-4354-bc1b-33de8239e566 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:52.651611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1091/2165] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:24:52.946938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbbe73-5067-4f5b-bc7d-fa4cd7218e54 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:24:52.948900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-abdbbe73-5067-4f5b-bc7d-fa4cd7218e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:24:52.961262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbbe73-5067-4f5b-bc7d-fa4cd7218e54 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:24:52.966303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:24:52.966966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:24:52.967286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:24:52.967567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] PATH_INFO: `/v3/projects/34d5800860f1435dbb7400eb7a016976` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:24:52.968767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d5800860f1435dbb7400eb7a016976)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:24:52.970721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:24:53.020715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d5800860f1435dbb7400eb7a016976', 'request_id': 'req-49f27933-0e87-46d5-9876-c2d494fea6c8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:53.028509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d5800860f1435dbb7400eb7a016976', 'request_id': 'req-49f27933-0e87-46d5-9876-c2d494fea6c8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:53.036054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d5800860f1435dbb7400eb7a016976', 'request_id': 'req-49f27933-0e87-46d5-9876-c2d494fea6c8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:53.049647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] The token cache is being invalidate because project 34d5800860f1435dbb7400eb7a016976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:24:53.050127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:53.050776 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:24:53.061842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1075/2166] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:24:52 2022] DELETE /identity/v3/projects/34d5800860f1435dbb7400eb7a016976 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:01.179328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f86e-3ffd-414e-9b33-f7bea0fe8c4e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:01.179846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f86e-3ffd-414e-9b33-f7bea0fe8c4e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:01.179937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f86e-3ffd-414e-9b33-f7bea0fe8c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:01.198980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b967f86e-3ffd-414e-9b33-f7bea0fe8c4e None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:01.200160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b967f86e-3ffd-414e-9b33-f7bea0fe8c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:01.256563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1092/2167] 10.222.0.15 () {58 vars in 967 bytes} [Thu Oct 6 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:01.270620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:01.272002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:01.347008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f27933-0e87-46d5-9876-c2d494fea6c8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:01.354960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108d2c1-e726-4fb0-b88c-c690ed13ba92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:01.355677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108d2c1-e726-4fb0-b88c-c690ed13ba92 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:01.355967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108d2c1-e726-4fb0-b88c-c690ed13ba92 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:01.356273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108d2c1-e726-4fb0-b88c-c690ed13ba92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:01.366058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108d2c1-e726-4fb0-b88c-c690ed13ba92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:01.367648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108d2c1-e726-4fb0-b88c-c690ed13ba92 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:01.376352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1076/2168] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:25:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:25:01.485056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967f86e-3ffd-414e-9b33-f7bea0fe8c4e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:01.486805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b967f86e-3ffd-414e-9b33-f7bea0fe8c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:01.559213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967f86e-3ffd-414e-9b33-f7bea0fe8c4e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:01.564748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:01.565388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:01.565704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:01.565979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] PATH_INFO: `/v3/users/7832daf9ded94870808b42972bfa5a58` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:01.567273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7832daf9ded94870808b42972bfa5a58)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:01.569214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:01.621521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7832daf9ded94870808b42972bfa5a58'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:01.622278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7832daf9ded94870808b42972bfa5a58'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:01.622957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7832daf9ded94870808b42972bfa5a58'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:01.639027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7832daf9ded94870808b42972bfa5a58'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:01.647994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7832daf9ded94870808b42972bfa5a58'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:01.654076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:01.664954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1093/2169] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:25:01 2022] DELETE /identity/v3/users/7832daf9ded94870808b42972bfa5a58 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:01.669842 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45fa1-63b5-4ce1-96ba-16f61b80da1c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:01.670233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45fa1-63b5-4ce1-96ba-16f61b80da1c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:01.670533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45fa1-63b5-4ce1-96ba-16f61b80da1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:01.694392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f9d45fa1-63b5-4ce1-96ba-16f61b80da1c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:01.695607 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9d45fa1-63b5-4ce1-96ba-16f61b80da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:01.754702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:01.776447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1077/2170] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:25:01.777489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:01.779019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:01.853159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e026d-6e12-4286-b2c0-8b73975b93b8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:01.857021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063327a-294c-434b-90b8-f5d907f99d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:01.857816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063327a-294c-434b-90b8-f5d907f99d2b service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:01.858512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063327a-294c-434b-90b8-f5d907f99d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:01.858855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063327a-294c-434b-90b8-f5d907f99d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:01.868542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063327a-294c-434b-90b8-f5d907f99d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:01.870054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063327a-294c-434b-90b8-f5d907f99d2b service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:01.880410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1094/2171] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:25:02.183094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d45fa1-63b5-4ce1-96ba-16f61b80da1c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:02.184670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9d45fa1-63b5-4ce1-96ba-16f61b80da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:02.198780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d45fa1-63b5-4ce1-96ba-16f61b80da1c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:02.214416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:02.215081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.215369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.215648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] PATH_INFO: `/v3/projects/e486c3d56d32462b827d18f70227a101` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.216840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e486c3d56d32462b827d18f70227a101)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:02.219494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:02.271199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e486c3d56d32462b827d18f70227a101', 'request_id': 'req-232f9d61-d71e-41cc-87d9-4a44030bd8d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:02.278534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e486c3d56d32462b827d18f70227a101', 'request_id': 'req-232f9d61-d71e-41cc-87d9-4a44030bd8d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:02.284709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e486c3d56d32462b827d18f70227a101', 'request_id': 'req-232f9d61-d71e-41cc-87d9-4a44030bd8d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:02.298660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] The token cache is being invalidate because project e486c3d56d32462b827d18f70227a101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:25:02.299272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:02.300088 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-232f9d61-d71e-41cc-87d9-4a44030bd8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:02.301469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1078/2172] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:25:02 2022] DELETE /identity/v3/projects/e486c3d56d32462b827d18f70227a101 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:02.306723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067a4a-b8e8-43ac-bf83-83d935f0a856 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.307221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067a4a-b8e8-43ac-bf83-83d935f0a856 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.307322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067a4a-b8e8-43ac-bf83-83d935f0a856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.330010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-99067a4a-b8e8-43ac-bf83-83d935f0a856 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:02.331782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-99067a4a-b8e8-43ac-bf83-83d935f0a856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:02.398799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1095/2173] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:25:02.407677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b045dc-b0b5-412e-8e86-464eb756f303 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.407971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b045dc-b0b5-412e-8e86-464eb756f303 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.408253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b045dc-b0b5-412e-8e86-464eb756f303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.429908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-24b045dc-b0b5-412e-8e86-464eb756f303 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:02.433270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-24b045dc-b0b5-412e-8e86-464eb756f303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:02.442084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1079/2174] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:25:02.446639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99067a4a-b8e8-43ac-bf83-83d935f0a856 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:02.458056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99067a4a-b8e8-43ac-bf83-83d935f0a856 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:02.463278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:02.464024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.464305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.464579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.465780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:25:02.466197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:02.468922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:02.481590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1096/2175] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:25:02.487371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b045dc-b0b5-412e-8e86-464eb756f303 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:02.496795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b045dc-b0b5-412e-8e86-464eb756f303 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:02.502576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f427-48d4-45da-be8b-a91438dfbaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:02.503260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f427-48d4-45da-be8b-a91438dfbaeb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.503546 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f427-48d4-45da-be8b-a91438dfbaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.503821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f427-48d4-45da-be8b-a91438dfbaeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.504473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f427-48d4-45da-be8b-a91438dfbaeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:02.506744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f427-48d4-45da-be8b-a91438dfbaeb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:02.538609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1080/2176] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:25:02 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:25:02.543130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:02.555577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63589a3e-3449-43cb-b4d2-4daf572289f0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:02.623064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cc361-576a-4989-8d41-749b2c855254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:02.623838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc361-576a-4989-8d41-749b2c855254 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.624120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc361-576a-4989-8d41-749b2c855254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.624434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc361-576a-4989-8d41-749b2c855254 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.625510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cc361-576a-4989-8d41-749b2c855254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:02.627781 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cc361-576a-4989-8d41-749b2c855254 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:02.652015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1097/2177] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:25:02 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:25:02.657518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f427-48d4-45da-be8b-a91438dfbaeb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:02.668364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f427-48d4-45da-be8b-a91438dfbaeb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:02.673264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c07a-f1e6-4469-8ecf-fc0500fe9121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:02.673901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c07a-f1e6-4469-8ecf-fc0500fe9121 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.674268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c07a-f1e6-4469-8ecf-fc0500fe9121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.674543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c07a-f1e6-4469-8ecf-fc0500fe9121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.675257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c07a-f1e6-4469-8ecf-fc0500fe9121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:02.677017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c07a-f1e6-4469-8ecf-fc0500fe9121 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:02.688695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1081/2178] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:25:02.693329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cc361-576a-4989-8d41-749b2c855254 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:02.704033 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cc361-576a-4989-8d41-749b2c855254 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:02.709321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4b83e-9d89-452f-903a-33c4c5772db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:02.709967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4b83e-9d89-452f-903a-33c4c5772db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.710243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4b83e-9d89-452f-903a-33c4c5772db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.710539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4b83e-9d89-452f-903a-33c4c5772db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.711186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4b83e-9d89-452f-903a-33c4c5772db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:02.712811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4b83e-9d89-452f-903a-33c4c5772db3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:02.725518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1098/2179] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:25:02.729869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c07a-f1e6-4469-8ecf-fc0500fe9121 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:02.741246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c07a-f1e6-4469-8ecf-fc0500fe9121 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:02.747079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02353e8-f72d-4c20-8245-6ff47e77553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:02.747738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02353e8-f72d-4c20-8245-6ff47e77553c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.748025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02353e8-f72d-4c20-8245-6ff47e77553c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.748327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02353e8-f72d-4c20-8245-6ff47e77553c admin admin] PATH_INFO: `/v3/projects/11578cf79b2c41a5aff20d333a3847b7/users/829544bf69c146c8afe3b1d33fe7ba72/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.766475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02353e8-f72d-4c20-8245-6ff47e77553c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11578cf79b2c41a5aff20d333a3847b7, user_id=829544bf69c146c8afe3b1d33fe7ba72, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:02.769156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02353e8-f72d-4c20-8245-6ff47e77553c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:02.793970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1082/2180] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:25:02 2022] PUT /identity/v3/projects/11578cf79b2c41a5aff20d333a3847b7/users/829544bf69c146c8afe3b1d33fe7ba72/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:02.807116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882cb94-3afb-4ce4-a3c3-8aa5c67850d8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:02.807393 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882cb94-3afb-4ce4-a3c3-8aa5c67850d8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:02.807664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882cb94-3afb-4ce4-a3c3-8aa5c67850d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:02.816451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:02.841067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6882cb94-3afb-4ce4-a3c3-8aa5c67850d8 None None] MFA Rules not processed for user `829544bf69c146c8afe3b1d33fe7ba72`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:02.842932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6882cb94-3afb-4ce4-a3c3-8aa5c67850d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:02.919244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1099/2181] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:02.925112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02353e8-f72d-4c20-8245-6ff47e77553c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:02.996239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02353e8-f72d-4c20-8245-6ff47e77553c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:03.004074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd336b9-cc02-4adc-ae09-48f6b5f0e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:03.004804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd336b9-cc02-4adc-ae09-48f6b5f0e47a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.005114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd336b9-cc02-4adc-ae09-48f6b5f0e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.005450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd336b9-cc02-4adc-ae09-48f6b5f0e47a admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.006135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd336b9-cc02-4adc-ae09-48f6b5f0e47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:03.008050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd336b9-cc02-4adc-ae09-48f6b5f0e47a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:03.043929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1083/2182] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:25:02 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:25:03.045182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882cb94-3afb-4ce4-a3c3-8aa5c67850d8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:03.057043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882cb94-3afb-4ce4-a3c3-8aa5c67850d8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:03.132193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197243ce-14d4-4e66-af27-c3c96f9cfc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:03.132193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197243ce-14d4-4e66-af27-c3c96f9cfc53 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.132193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197243ce-14d4-4e66-af27-c3c96f9cfc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.132193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197243ce-14d4-4e66-af27-c3c96f9cfc53 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.132673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197243ce-14d4-4e66-af27-c3c96f9cfc53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:03.133457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197243ce-14d4-4e66-af27-c3c96f9cfc53 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:03.162954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1100/2183] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:25:03 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:25:03.164069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd336b9-cc02-4adc-ae09-48f6b5f0e47a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:03.172548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:03.176740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd336b9-cc02-4adc-ae09-48f6b5f0e47a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:03.185203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7d63-f110-4dc2-9d8c-ac00901cdf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:03.186886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7d63-f110-4dc2-9d8c-ac00901cdf01 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.187523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7d63-f110-4dc2-9d8c-ac00901cdf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.187872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7d63-f110-4dc2-9d8c-ac00901cdf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.188691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace7d63-f110-4dc2-9d8c-ac00901cdf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:03.190634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace7d63-f110-4dc2-9d8c-ac00901cdf01 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:03.204350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1084/2184] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:25:03.209051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197243ce-14d4-4e66-af27-c3c96f9cfc53 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:03.222251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197243ce-14d4-4e66-af27-c3c96f9cfc53 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:03.227545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9bb61-e002-4d1e-ba8f-2a51ca20d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:03.228517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9bb61-e002-4d1e-ba8f-2a51ca20d0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.228938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9bb61-e002-4d1e-ba8f-2a51ca20d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.229347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9bb61-e002-4d1e-ba8f-2a51ca20d0f1 admin admin] PATH_INFO: `/v3/projects/362b9fe0666c421aa3ef1333e9e7e90c/users/378268719af64a4e859e06384d055586/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.250916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9bb61-e002-4d1e-ba8f-2a51ca20d0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362b9fe0666c421aa3ef1333e9e7e90c, user_id=378268719af64a4e859e06384d055586, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:03.255331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9bb61-e002-4d1e-ba8f-2a51ca20d0f1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:03.279849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1101/2185] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:25:03 2022] PUT /identity/v3/projects/362b9fe0666c421aa3ef1333e9e7e90c/users/378268719af64a4e859e06384d055586/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:03.281318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7d63-f110-4dc2-9d8c-ac00901cdf01 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:03.292036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7d63-f110-4dc2-9d8c-ac00901cdf01 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:03.362641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2c10b-03a8-40ba-938b-aeedd319b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:03.363400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c10b-03a8-40ba-938b-aeedd319b7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.363692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c10b-03a8-40ba-938b-aeedd319b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.364358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c10b-03a8-40ba-938b-aeedd319b7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.364638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2c10b-03a8-40ba-938b-aeedd319b7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:03.366577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2c10b-03a8-40ba-938b-aeedd319b7b6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:03.378199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1085/2186] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:25:03.383298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9bb61-e002-4d1e-ba8f-2a51ca20d0f1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:03.395992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9bb61-e002-4d1e-ba8f-2a51ca20d0f1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:03.401703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:03.402482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.402853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.403204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] PATH_INFO: `/v3/projects/362b9fe0666c421aa3ef1333e9e7e90c/users/378268719af64a4e859e06384d055586/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.406092 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=362b9fe0666c421aa3ef1333e9e7e90c, user_id=378268719af64a4e859e06384d055586, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:03.408826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:03.421154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1102/2187] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:25:03 2022] PUT /identity/v3/projects/362b9fe0666c421aa3ef1333e9e7e90c/users/378268719af64a4e859e06384d055586/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:03.431475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5090-db18-4ad4-b467-9b44c93e81e1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.431907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5090-db18-4ad4-b467-9b44c93e81e1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.432200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5090-db18-4ad4-b467-9b44c93e81e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.465961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-60ee5090-db18-4ad4-b467-9b44c93e81e1 None None] MFA Rules not processed for user `378268719af64a4e859e06384d055586`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:03.467529 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-60ee5090-db18-4ad4-b467-9b44c93e81e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:03.471215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:03.472993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:03.542774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:03.565576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1086/2188] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:03.571633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420687-22d8-44d8-baa9-dade296f57ee admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:03.576680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:03.577461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.577877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.578234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] PATH_INFO: `/v3/users/a517a1b28e8a45d4ad50a6c0a0a7e3ea` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.579698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee5090-db18-4ad4-b467-9b44c93e81e1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:03.579845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a517a1b28e8a45d4ad50a6c0a0a7e3ea)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:03.581765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-60ee5090-db18-4ad4-b467-9b44c93e81e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:03.584943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:03.651190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a517a1b28e8a45d4ad50a6c0a0a7e3ea'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:03.651990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a517a1b28e8a45d4ad50a6c0a0a7e3ea'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:03.652569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a517a1b28e8a45d4ad50a6c0a0a7e3ea'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:03.659335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee5090-db18-4ad4-b467-9b44c93e81e1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:03.664030 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90f8e-53c3-48e7-a659-6568a27b0ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:03.664641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90f8e-53c3-48e7-a659-6568a27b0ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:03.664919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90f8e-53c3-48e7-a659-6568a27b0ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:03.665189 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90f8e-53c3-48e7-a659-6568a27b0ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:03.666987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d8a90f8e-53c3-48e7-a659-6568a27b0ed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:03.667905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a517a1b28e8a45d4ad50a6c0a0a7e3ea'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:03.677936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a517a1b28e8a45d4ad50a6c0a0a7e3ea'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:03.693602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1103/2189] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:25:03 2022] DELETE /identity/v3/users/a517a1b28e8a45d4ad50a6c0a0a7e3ea => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:03.702843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:03.741274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90f8e-53c3-48e7-a659-6568a27b0ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:03.742791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90f8e-53c3-48e7-a659-6568a27b0ed7 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:03.758771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1087/2190] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:25:03.908737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:03.910271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:04.004399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77690-44ed-4222-a8eb-3bab0deba219 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:04.009592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:04.010286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.010589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.010897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] PATH_INFO: `/v3/projects/4d866a0dd7a64266bbc706ff702ce8d1` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.012038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d866a0dd7a64266bbc706ff702ce8d1)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:04.014740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:04.072716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d866a0dd7a64266bbc706ff702ce8d1', 'request_id': 'req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:04.080850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d866a0dd7a64266bbc706ff702ce8d1', 'request_id': 'req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:04.089832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d866a0dd7a64266bbc706ff702ce8d1', 'request_id': 'req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:04.100342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:04.115272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] The token cache is being invalidate because project 4d866a0dd7a64266bbc706ff702ce8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:25:04.115564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:04.116251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8fe65b22-6b70-4fd2-b76e-3e1760e4bebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:04.117789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1104/2191] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:25:03 2022] DELETE /identity/v3/projects/4d866a0dd7a64266bbc706ff702ce8d1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:04.122698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb28d6-504d-47cf-acf0-20010e09f454 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.123050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb28d6-504d-47cf-acf0-20010e09f454 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.123488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb28d6-504d-47cf-acf0-20010e09f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.153263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b2fb28d6-504d-47cf-acf0-20010e09f454 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:04.154732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b2fb28d6-504d-47cf-acf0-20010e09f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:04.255145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1088/2192] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:25:04.265045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea283d-6f57-4137-8aee-a06aa187f67f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.265833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea283d-6f57-4137-8aee-a06aa187f67f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.266241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea283d-6f57-4137-8aee-a06aa187f67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.289028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-81ea283d-6f57-4137-8aee-a06aa187f67f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:04.290343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-81ea283d-6f57-4137-8aee-a06aa187f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:04.299348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1105/2193] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:04.303713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb28d6-504d-47cf-acf0-20010e09f454 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:04.314765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb28d6-504d-47cf-acf0-20010e09f454 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:04.319635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:04.320307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.320651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.321012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.321770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:25:04.322159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:04.323820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:04.336104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1089/2194] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:25:04.340936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea283d-6f57-4137-8aee-a06aa187f67f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:04.361130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea283d-6f57-4137-8aee-a06aa187f67f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:04.365946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3400ec-3393-4399-ac65-ef77449924c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:04.366501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3400ec-3393-4399-ac65-ef77449924c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.366779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3400ec-3393-4399-ac65-ef77449924c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.367049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3400ec-3393-4399-ac65-ef77449924c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.367750 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3400ec-3393-4399-ac65-ef77449924c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:04.369702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3400ec-3393-4399-ac65-ef77449924c6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:04.403307 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1106/2195] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:25:04 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:25:04.408300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:04.418736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5255-0a90-49f2-8c08-ba4d102191ff admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:04.477181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26898e51-4195-4bf6-a85b-0f83de754161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:04.477831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898e51-4195-4bf6-a85b-0f83de754161 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.478121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898e51-4195-4bf6-a85b-0f83de754161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.478399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898e51-4195-4bf6-a85b-0f83de754161 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.479060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26898e51-4195-4bf6-a85b-0f83de754161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:04.481040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26898e51-4195-4bf6-a85b-0f83de754161 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:04.505221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1090/2196] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:25:04 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:25:04.509648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3400ec-3393-4399-ac65-ef77449924c6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:04.521129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3400ec-3393-4399-ac65-ef77449924c6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:04.526671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07acf-5aac-478c-aac9-92e6afcddbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:04.527279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07acf-5aac-478c-aac9-92e6afcddbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.527556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07acf-5aac-478c-aac9-92e6afcddbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.527830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07acf-5aac-478c-aac9-92e6afcddbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.528475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07acf-5aac-478c-aac9-92e6afcddbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:04.530685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07acf-5aac-478c-aac9-92e6afcddbbf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:04.541252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1107/2197] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:25:04.546222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26898e51-4195-4bf6-a85b-0f83de754161 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:04.556407 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26898e51-4195-4bf6-a85b-0f83de754161 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:04.561213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6319aa-33cb-4527-8908-e31275d90494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:04.561852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6319aa-33cb-4527-8908-e31275d90494 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.562137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6319aa-33cb-4527-8908-e31275d90494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.562407 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6319aa-33cb-4527-8908-e31275d90494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.563063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6319aa-33cb-4527-8908-e31275d90494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:04.564638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6319aa-33cb-4527-8908-e31275d90494 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:04.575676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1091/2198] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:25:04.580046 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07acf-5aac-478c-aac9-92e6afcddbbf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:04.589893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07acf-5aac-478c-aac9-92e6afcddbbf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:04.595561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6660b-679f-4e27-9c41-52542a790259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:04.596213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6660b-679f-4e27-9c41-52542a790259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.596495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6660b-679f-4e27-9c41-52542a790259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.596767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6660b-679f-4e27-9c41-52542a790259 admin admin] PATH_INFO: `/v3/projects/7d5563aa54de48a1aac069dacae4fc05/users/6e85dd23d9a54ce49ac9e3dd4f478a12/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.612447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6660b-679f-4e27-9c41-52542a790259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5563aa54de48a1aac069dacae4fc05, user_id=6e85dd23d9a54ce49ac9e3dd4f478a12, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:04.615264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6660b-679f-4e27-9c41-52542a790259 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:04.630333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1108/2199] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:25:04 2022] PUT /identity/v3/projects/7d5563aa54de48a1aac069dacae4fc05/users/6e85dd23d9a54ce49ac9e3dd4f478a12/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:04.635338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d658fd7-63d0-4e52-a9ef-523cfaf33c1e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.635632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d658fd7-63d0-4e52-a9ef-523cfaf33c1e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.635911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d658fd7-63d0-4e52-a9ef-523cfaf33c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.657495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0d658fd7-63d0-4e52-a9ef-523cfaf33c1e None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:04.658764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0d658fd7-63d0-4e52-a9ef-523cfaf33c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:04.691065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:04.727564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f209132-11b5-44c8-972e-301a6e47c4a3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.727723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1092/2200] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:04.728359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f209132-11b5-44c8-972e-301a6e47c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.728788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f209132-11b5-44c8-972e-301a6e47c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.738339 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d658fd7-63d0-4e52-a9ef-523cfaf33c1e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:04.739814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0d658fd7-63d0-4e52-a9ef-523cfaf33c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:04.749659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2f209132-11b5-44c8-972e-301a6e47c4a3 None None] MFA Rules not processed for user `f4a9da2cec0d420b800b99797166893f`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:04.750842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2f209132-11b5-44c8-972e-301a6e47c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:04.799755 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d658fd7-63d0-4e52-a9ef-523cfaf33c1e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:04.803557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:04.804168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:04.804452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:04.804726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:04.807263 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1109/2201] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:04.814751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:04.816208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:04.826242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1093/2202] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:25:05.773666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727df4c-5db4-4367-9d76-b7a467d355bb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:05.774378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727df4c-5db4-4367-9d76-b7a467d355bb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:05.774696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727df4c-5db4-4367-9d76-b7a467d355bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:05.808340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4727df4c-5db4-4367-9d76-b7a467d355bb None None] MFA Rules not processed for user `6e85dd23d9a54ce49ac9e3dd4f478a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:05.811566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4727df4c-5db4-4367-9d76-b7a467d355bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:05.883128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1110/2203] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:05.894474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:05.896033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:05.966218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d45b33-c8fe-47e0-9f75-0d5c73dc54a5 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:05.973909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1168d-3e8d-406a-ac51-72a83d545b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:05.974738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1168d-3e8d-406a-ac51-72a83d545b94 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:05.975019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1168d-3e8d-406a-ac51-72a83d545b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:05.975389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1168d-3e8d-406a-ac51-72a83d545b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:05.985824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1168d-3e8d-406a-ac51-72a83d545b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:05.987326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1168d-3e8d-406a-ac51-72a83d545b94 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:05.997311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1094/2204] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:25:06.547061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727df4c-5db4-4367-9d76-b7a467d355bb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:06.548482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4727df4c-5db4-4367-9d76-b7a467d355bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:06.562156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727df4c-5db4-4367-9d76-b7a467d355bb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:06.566570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:06.567188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:06.567463 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:06.567735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] PATH_INFO: `/v3/users/829544bf69c146c8afe3b1d33fe7ba72` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:06.568830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829544bf69c146c8afe3b1d33fe7ba72)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:06.570783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:06.595658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:06.622010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829544bf69c146c8afe3b1d33fe7ba72'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:06.622659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829544bf69c146c8afe3b1d33fe7ba72'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:06.623275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829544bf69c146c8afe3b1d33fe7ba72'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:06.640932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829544bf69c146c8afe3b1d33fe7ba72'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:06.648722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829544bf69c146c8afe3b1d33fe7ba72'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:06.662637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1111/2205] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:25:06 2022] DELETE /identity/v3/users/829544bf69c146c8afe3b1d33fe7ba72 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:06.667142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a834da-4d36-42ba-9a47-9a02c0855ef0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:06.667435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a834da-4d36-42ba-9a47-9a02c0855ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:06.667714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a834da-4d36-42ba-9a47-9a02c0855ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:06.687471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-91a834da-4d36-42ba-9a47-9a02c0855ef0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:06.688677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-91a834da-4d36-42ba-9a47-9a02c0855ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:06.746838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1095/2206] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:06.757039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:06.758480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:06.819923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93849f4-b5a4-4416-bb91-f88fcd11da53 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:06.823914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a04f6d-2271-4393-aeee-302b432e98ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:06.824531 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04f6d-2271-4393-aeee-302b432e98ad service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:06.824819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04f6d-2271-4393-aeee-302b432e98ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:06.825089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a04f6d-2271-4393-aeee-302b432e98ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:06.835297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a04f6d-2271-4393-aeee-302b432e98ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:06.836762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a04f6d-2271-4393-aeee-302b432e98ad service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:06.847439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1112/2207] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:25:07.161700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a834da-4d36-42ba-9a47-9a02c0855ef0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:07.163151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-91a834da-4d36-42ba-9a47-9a02c0855ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:07.175430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a834da-4d36-42ba-9a47-9a02c0855ef0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:07.180114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:07.180757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:07.181041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:07.181316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] PATH_INFO: `/v3/projects/11578cf79b2c41a5aff20d333a3847b7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:07.182478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11578cf79b2c41a5aff20d333a3847b7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:07.184396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:07.203180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:07.234586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11578cf79b2c41a5aff20d333a3847b7', 'request_id': 'req-b3b429fa-59af-46df-89c6-0a51cf893834'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.241523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11578cf79b2c41a5aff20d333a3847b7', 'request_id': 'req-b3b429fa-59af-46df-89c6-0a51cf893834'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.247243 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11578cf79b2c41a5aff20d333a3847b7', 'request_id': 'req-b3b429fa-59af-46df-89c6-0a51cf893834'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.258730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] The token cache is being invalidate because project 11578cf79b2c41a5aff20d333a3847b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:25:07.259024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.259657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3b429fa-59af-46df-89c6-0a51cf893834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.261130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1096/2208] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:25:07 2022] DELETE /identity/v3/projects/11578cf79b2c41a5aff20d333a3847b7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:07.265680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a04f6d-2271-4393-aeee-302b432e98ad service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:07.275494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a04f6d-2271-4393-aeee-302b432e98ad service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:07.344268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:07.345252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:07.345605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:07.345908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] PATH_INFO: `/v3/users/378268719af64a4e859e06384d055586` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:07.347037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=378268719af64a4e859e06384d055586)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:07.349104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:07.402599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:07.405566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ca14f-d0f3-49de-b31d-791994011cb1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:07.406504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378268719af64a4e859e06384d055586'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.407432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ca14f-d0f3-49de-b31d-791994011cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:07.407939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ca14f-d0f3-49de-b31d-791994011cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:07.408447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378268719af64a4e859e06384d055586'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.409784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378268719af64a4e859e06384d055586'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.427454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378268719af64a4e859e06384d055586'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.431260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-299ca14f-d0f3-49de-b31d-791994011cb1 None None] MFA Rules not processed for user `6e85dd23d9a54ce49ac9e3dd4f478a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:07.432785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-299ca14f-d0f3-49de-b31d-791994011cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:07.437336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378268719af64a4e859e06384d055586'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.453421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1113/2209] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:25:07 2022] DELETE /identity/v3/users/378268719af64a4e859e06384d055586 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:07.495468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1097/2210] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:25:07.754131 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:07.756120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:07.840853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae09137-bf3c-4f05-882a-ad14835001ff admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:07.845968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:07.846632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:07.846918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:07.847186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] PATH_INFO: `/v3/projects/362b9fe0666c421aa3ef1333e9e7e90c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:07.848358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362b9fe0666c421aa3ef1333e9e7e90c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:07.850309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:07.909687 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362b9fe0666c421aa3ef1333e9e7e90c', 'request_id': 'req-edd1ebf7-523b-4098-90cc-83c407361b01'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.918191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362b9fe0666c421aa3ef1333e9e7e90c', 'request_id': 'req-edd1ebf7-523b-4098-90cc-83c407361b01'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.926705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362b9fe0666c421aa3ef1333e9e7e90c', 'request_id': 'req-edd1ebf7-523b-4098-90cc-83c407361b01'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.943929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] The token cache is being invalidate because project 362b9fe0666c421aa3ef1333e9e7e90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:25:07.944152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.944993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edd1ebf7-523b-4098-90cc-83c407361b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:07.952017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1114/2211] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:25:07 2022] DELETE /identity/v3/projects/362b9fe0666c421aa3ef1333e9e7e90c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:07.953927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e27c4-d027-4ba1-93da-1ea63b2b3071 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:07.954516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e27c4-d027-4ba1-93da-1ea63b2b3071 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:07.954902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e27c4-d027-4ba1-93da-1ea63b2b3071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:07.986373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-da7e27c4-d027-4ba1-93da-1ea63b2b3071 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:07.987752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-da7e27c4-d027-4ba1-93da-1ea63b2b3071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:08.064046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1098/2212] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:08.072087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f79a1-bae7-4292-8f2b-29f13b029535 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.072428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f79a1-bae7-4292-8f2b-29f13b029535 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.072664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f79a1-bae7-4292-8f2b-29f13b029535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.093842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-766f79a1-bae7-4292-8f2b-29f13b029535 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:08.095077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-766f79a1-bae7-4292-8f2b-29f13b029535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:08.103433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1115/2213] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:08.108776 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e27c4-d027-4ba1-93da-1ea63b2b3071 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:08.119027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e27c4-d027-4ba1-93da-1ea63b2b3071 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:08.124413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:08.126021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.126021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.126370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.127374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:25:08.127829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:08.129653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:08.145705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1099/2214] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:25:08.147141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f79a1-bae7-4292-8f2b-29f13b029535 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:08.157678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f79a1-bae7-4292-8f2b-29f13b029535 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:08.162320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c7654-c57c-4612-a2e2-ae3953723e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:08.162934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c7654-c57c-4612-a2e2-ae3953723e8d admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.163211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c7654-c57c-4612-a2e2-ae3953723e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.163479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c7654-c57c-4612-a2e2-ae3953723e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.164127 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c7654-c57c-4612-a2e2-ae3953723e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:08.166063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c7654-c57c-4612-a2e2-ae3953723e8d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:08.195378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1116/2215] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:25:08 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:25:08.199623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:08.211162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9cc1-f659-4b80-99a1-22f47cd20c59 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:08.248146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:08.274828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16dbe0-92d8-4055-a3c5-8a8664145d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:08.275438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dbe0-92d8-4055-a3c5-8a8664145d20 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.275725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dbe0-92d8-4055-a3c5-8a8664145d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.276029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dbe0-92d8-4055-a3c5-8a8664145d20 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.276679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16dbe0-92d8-4055-a3c5-8a8664145d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:08.278681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16dbe0-92d8-4055-a3c5-8a8664145d20 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:08.310286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1100/2216] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:25:08 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:25:08.315492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c7654-c57c-4612-a2e2-ae3953723e8d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:08.327191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c7654-c57c-4612-a2e2-ae3953723e8d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:08.332845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75aef-7039-4489-9b80-fc0caec15b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:08.333628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75aef-7039-4489-9b80-fc0caec15b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.335761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75aef-7039-4489-9b80-fc0caec15b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.336103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75aef-7039-4489-9b80-fc0caec15b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.336823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75aef-7039-4489-9b80-fc0caec15b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:08.338576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75aef-7039-4489-9b80-fc0caec15b91 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:08.352257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1117/2217] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:25:08.353926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16dbe0-92d8-4055-a3c5-8a8664145d20 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:08.364995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16dbe0-92d8-4055-a3c5-8a8664145d20 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:08.369933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a7a86-67fe-47a0-b7c3-eecb510edd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:08.370650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7a86-67fe-47a0-b7c3-eecb510edd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.371146 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7a86-67fe-47a0-b7c3-eecb510edd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.371638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7a86-67fe-47a0-b7c3-eecb510edd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.372721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a7a86-67fe-47a0-b7c3-eecb510edd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:08.374671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a7a86-67fe-47a0-b7c3-eecb510edd19 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:08.389807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1101/2218] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:25:08.392147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75aef-7039-4489-9b80-fc0caec15b91 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:08.403294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75aef-7039-4489-9b80-fc0caec15b91 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:08.411097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:08.411787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.412067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.412344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] PATH_INFO: `/v3/projects/1be4e43b019b46a8a3a2351b21bc1afa/users/ef44d608bec841089d00d06cd42fbf4c/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.425042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:08.434880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be4e43b019b46a8a3a2351b21bc1afa, user_id=ef44d608bec841089d00d06cd42fbf4c, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:08.438762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:08.455804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1118/2219] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:25:08 2022] PUT /identity/v3/projects/1be4e43b019b46a8a3a2351b21bc1afa/users/ef44d608bec841089d00d06cd42fbf4c/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:08.467943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a638-a70f-479c-894c-164b5cf85e97 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.468368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a638-a70f-479c-894c-164b5cf85e97 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.468719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a638-a70f-479c-894c-164b5cf85e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.500756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e020a638-a70f-479c-894c-164b5cf85e97 None None] MFA Rules not processed for user `ef44d608bec841089d00d06cd42fbf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:08.502027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e020a638-a70f-479c-894c-164b5cf85e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:08.606013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1102/2220] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:08.617606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:08.619472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:08.709653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c099f0-2a6c-49d1-a63c-f491053d6fd1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:08.715284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee07bf3-7217-4b69-9a44-3500354970e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:08.715976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee07bf3-7217-4b69-9a44-3500354970e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:08.717565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee07bf3-7217-4b69-9a44-3500354970e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:08.718394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee07bf3-7217-4b69-9a44-3500354970e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:08.734828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee07bf3-7217-4b69-9a44-3500354970e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:08.734828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee07bf3-7217-4b69-9a44-3500354970e3 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:08.750956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1119/2221] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:25:18.600360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:18.741481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:18.991050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020a638-a70f-479c-894c-164b5cf85e97 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:19.055379 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020a638-a70f-479c-894c-164b5cf85e97 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:19.060081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:19.060575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:19.060862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:19.061139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] PATH_INFO: `/v3/users/ef44d608bec841089d00d06cd42fbf4c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:19.062673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef44d608bec841089d00d06cd42fbf4c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:19.064690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:19.119456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef44d608bec841089d00d06cd42fbf4c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.120162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef44d608bec841089d00d06cd42fbf4c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.132998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef44d608bec841089d00d06cd42fbf4c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.146042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef44d608bec841089d00d06cd42fbf4c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.153603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef44d608bec841089d00d06cd42fbf4c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.162587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1103/2222] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:25:18 2022] DELETE /identity/v3/users/ef44d608bec841089d00d06cd42fbf4c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:19.168046 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c994ae-7d3d-41dd-966f-e19380270cf3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:19.168582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c994ae-7d3d-41dd-966f-e19380270cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:19.168856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c994ae-7d3d-41dd-966f-e19380270cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:19.189939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-37c994ae-7d3d-41dd-966f-e19380270cf3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:19.191165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-37c994ae-7d3d-41dd-966f-e19380270cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:19.250754 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1120/2223] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:19.260400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:19.261891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:19.319442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb29d9-2054-4953-afaf-41623c97544b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:19.323122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e6fb-c40d-4f85-a509-d2470b7002d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:19.323726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e6fb-c40d-4f85-a509-d2470b7002d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:19.324012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e6fb-c40d-4f85-a509-d2470b7002d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:19.324291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e6fb-c40d-4f85-a509-d2470b7002d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:19.333856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35e6fb-c40d-4f85-a509-d2470b7002d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:19.335269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35e6fb-c40d-4f85-a509-d2470b7002d0 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:19.345361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1104/2224] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:25:19.704853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c994ae-7d3d-41dd-966f-e19380270cf3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:19.706385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-37c994ae-7d3d-41dd-966f-e19380270cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:19.719482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c994ae-7d3d-41dd-966f-e19380270cf3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:19.724386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:19.725184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:19.725377 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:19.725960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] PATH_INFO: `/v3/projects/1be4e43b019b46a8a3a2351b21bc1afa` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:19.726966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be4e43b019b46a8a3a2351b21bc1afa)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:19.728886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:19.779741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be4e43b019b46a8a3a2351b21bc1afa', 'request_id': 'req-991d3842-8f1a-481a-ba02-c7408ab09946'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.786768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be4e43b019b46a8a3a2351b21bc1afa', 'request_id': 'req-991d3842-8f1a-481a-ba02-c7408ab09946'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.792730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be4e43b019b46a8a3a2351b21bc1afa', 'request_id': 'req-991d3842-8f1a-481a-ba02-c7408ab09946'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.805385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] The token cache is being invalidate because project 1be4e43b019b46a8a3a2351b21bc1afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:25:19.806278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.806901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:25:19.808429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1121/2225] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:25:19 2022] DELETE /identity/v3/projects/1be4e43b019b46a8a3a2351b21bc1afa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:25:29.340968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:29.802265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:49.024559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00188-bb23-46e0-a00b-f76f8fb1e25b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:49.025010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00188-bb23-46e0-a00b-f76f8fb1e25b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:49.025193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00188-bb23-46e0-a00b-f76f8fb1e25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:49.047062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b7b00188-bb23-46e0-a00b-f76f8fb1e25b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:49.048285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b7b00188-bb23-46e0-a00b-f76f8fb1e25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:49.109695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1105/2226] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:49.143136 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:49.144642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:49.221484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d3842-8f1a-481a-ba02-c7408ab09946 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:49.227258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:49.227894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:49.228216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:49.228494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:49.241892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:49.243483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:49.254075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1122/2227] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:25:53.458049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a50a89-df98-4e21-9217-7fa3b1107e18 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:53.458544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a50a89-df98-4e21-9217-7fa3b1107e18 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:53.458662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a50a89-df98-4e21-9217-7fa3b1107e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:53.478295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-06a50a89-df98-4e21-9217-7fa3b1107e18 None None] MFA Rules not processed for user `57d8dd7c820144a082032626cb481df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:53.480143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-06a50a89-df98-4e21-9217-7fa3b1107e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:53.540343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1106/2228] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:54.971764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:54.973336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:55.087286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338bd4-9f6b-4502-a0d1-6c849d08faf2 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:55.102049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:55.102049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:55.102049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:55.102049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:55.103738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:55.117032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:55.118697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:55.129611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1123/2229] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:25:55.215911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0223e-9aca-494f-b76e-8ec0605ab3be None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:55.216425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0223e-9aca-494f-b76e-8ec0605ab3be None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:55.216425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0223e-9aca-494f-b76e-8ec0605ab3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:55.235771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e2d0223e-9aca-494f-b76e-8ec0605ab3be None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:55.236999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e2d0223e-9aca-494f-b76e-8ec0605ab3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:55.245506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1107/2230] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:55.297608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:55.299036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:55.314730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6493c-55a6-46a5-b25a-9ba2e1b7f799 service placement] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:55.320550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:55.321185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:55.321591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:55.321892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:55.331048 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:55.332626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:55.342002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1124/2231] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:25:59.429486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4403-dc5a-4683-ae8e-6a2ded85bed0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:59.430084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4403-dc5a-4683-ae8e-6a2ded85bed0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:59.430084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4403-dc5a-4683-ae8e-6a2ded85bed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:59.450591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b65b4403-dc5a-4683-ae8e-6a2ded85bed0 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:25:59.452127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b65b4403-dc5a-4683-ae8e-6a2ded85bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:59.517727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1108/2232] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:25:59.538329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:25:59.539892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:25:59.619417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:25:59.624839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef810b3-ef0b-4135-8c2c-92049ed2fba0 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:25:59.632036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12d20a-b7ae-4462-8ea9-2666aaf557c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:25:59.632699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d20a-b7ae-4462-8ea9-2666aaf557c2 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:25:59.633125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d20a-b7ae-4462-8ea9-2666aaf557c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:25:59.633557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d20a-b7ae-4462-8ea9-2666aaf557c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:25:59.645483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12d20a-b7ae-4462-8ea9-2666aaf557c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:25:59.647852 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12d20a-b7ae-4462-8ea9-2666aaf557c2 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:25:59.659710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1125/2233] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:25:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:26:00.740323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ebced-5c73-49c9-9c57-b975f421e673 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:00.741173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ebced-5c73-49c9-9c57-b975f421e673 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:00.741173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ebced-5c73-49c9-9c57-b975f421e673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:00.782836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fa9ebced-5c73-49c9-9c57-b975f421e673 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:00.784054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa9ebced-5c73-49c9-9c57-b975f421e673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:00.804646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1109/2234] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:00.828921 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12d20a-b7ae-4462-8ea9-2666aaf557c2 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:00.846856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12d20a-b7ae-4462-8ea9-2666aaf557c2 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:00.861032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe8d92-c348-4612-bed6-725c72526f12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:00.861773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8d92-c348-4612-bed6-725c72526f12 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:00.861939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8d92-c348-4612-bed6-725c72526f12 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:00.862208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8d92-c348-4612-bed6-725c72526f12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:00.883042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe8d92-c348-4612-bed6-725c72526f12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:00.885215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe8d92-c348-4612-bed6-725c72526f12 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:00.896412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1126/2235] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:26:04.897231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe50bfb-d806-4ac6-b591-1c6e3c473321 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:04.897895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe50bfb-d806-4ac6-b591-1c6e3c473321 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:04.897895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe50bfb-d806-4ac6-b591-1c6e3c473321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:04.958247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bfe50bfb-d806-4ac6-b591-1c6e3c473321 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:04.959750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bfe50bfb-d806-4ac6-b591-1c6e3c473321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:04.972656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1110/2236] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:05.045496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe8d92-c348-4612-bed6-725c72526f12 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:05.061322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe8d92-c348-4612-bed6-725c72526f12 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:05.074050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544ed70-4631-460d-bf07-acf2e1f803a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:05.074674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ed70-4631-460d-bf07-acf2e1f803a2 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:05.074949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ed70-4631-460d-bf07-acf2e1f803a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:05.075217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ed70-4631-460d-bf07-acf2e1f803a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:05.087884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544ed70-4631-460d-bf07-acf2e1f803a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:05.090428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544ed70-4631-460d-bf07-acf2e1f803a2 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:05.109527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1127/2237] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:26:12.280490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839c38-fe91-4802-baa0-96589d93a277 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:12.281097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839c38-fe91-4802-baa0-96589d93a277 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:12.281097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839c38-fe91-4802-baa0-96589d93a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:12.292729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:12.305826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2b839c38-fe91-4802-baa0-96589d93a277 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:12.307656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b839c38-fe91-4802-baa0-96589d93a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:12.316058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1111/2238] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:12.339880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544ed70-4631-460d-bf07-acf2e1f803a2 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:12.352519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544ed70-4631-460d-bf07-acf2e1f803a2 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:12.361087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b1306-4689-4238-bed7-4e8e2e00554d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:12.361761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b1306-4689-4238-bed7-4e8e2e00554d service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:12.362047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b1306-4689-4238-bed7-4e8e2e00554d service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:12.362317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b1306-4689-4238-bed7-4e8e2e00554d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:12.371489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b1306-4689-4238-bed7-4e8e2e00554d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:12.373742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b1306-4689-4238-bed7-4e8e2e00554d service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:12.384893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1128/2239] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:26:17.512318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707c2f-03d4-494a-b646-f413677119dd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:17.513126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707c2f-03d4-494a-b646-f413677119dd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:17.513857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707c2f-03d4-494a-b646-f413677119dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:17.539284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e7707c2f-03d4-494a-b646-f413677119dd None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:17.541611 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e7707c2f-03d4-494a-b646-f413677119dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:17.550363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1112/2240] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:17.576007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b1306-4689-4238-bed7-4e8e2e00554d service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:17.588506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b1306-4689-4238-bed7-4e8e2e00554d service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:17.594614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657456e-1fa7-4cfc-8e7a-9311c0633118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:17.595235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657456e-1fa7-4cfc-8e7a-9311c0633118 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:17.595680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657456e-1fa7-4cfc-8e7a-9311c0633118 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:17.596096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657456e-1fa7-4cfc-8e7a-9311c0633118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:17.607076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657456e-1fa7-4cfc-8e7a-9311c0633118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:17.609047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657456e-1fa7-4cfc-8e7a-9311c0633118 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:17.620401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1129/2241] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:26:20.786856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916706b3-d5b7-457f-83f5-497832c4ada8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:20.787414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916706b3-d5b7-457f-83f5-497832c4ada8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:20.787414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916706b3-d5b7-457f-83f5-497832c4ada8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:20.790993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1113/2242] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:26:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:26:20.797655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3705-1d7d-4ffe-8c12-9f2e983bbdd4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:20.798186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3705-1d7d-4ffe-8c12-9f2e983bbdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:20.798610 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3705-1d7d-4ffe-8c12-9f2e983bbdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:20.830822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-198c3705-1d7d-4ffe-8c12-9f2e983bbdd4 None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:20.832240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-198c3705-1d7d-4ffe-8c12-9f2e983bbdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:20.844035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1130/2243] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:20.857752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916706b3-d5b7-457f-83f5-497832c4ada8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:20.859582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-916706b3-d5b7-457f-83f5-497832c4ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:20.925340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916706b3-d5b7-457f-83f5-497832c4ada8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:20.929185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0afe9-89d7-4ce3-88ae-35715edd69b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:20.929828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0afe9-89d7-4ce3-88ae-35715edd69b0 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:20.930166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0afe9-89d7-4ce3-88ae-35715edd69b0 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:20.930403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0afe9-89d7-4ce3-88ae-35715edd69b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:20.944700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0afe9-89d7-4ce3-88ae-35715edd69b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:20.946693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0afe9-89d7-4ce3-88ae-35715edd69b0 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:20.958332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1114/2244] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:26:21.040755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248bc9-4491-462f-b677-01d2c9175f17 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:21.041072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248bc9-4491-462f-b677-01d2c9175f17 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:21.041357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248bc9-4491-462f-b677-01d2c9175f17 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:21.042773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1131/2245] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:26:21.048326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562bb97-8d8e-4929-aa42-c8b5fb8748f4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:21.048621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562bb97-8d8e-4929-aa42-c8b5fb8748f4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:21.048904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562bb97-8d8e-4929-aa42-c8b5fb8748f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:21.069571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f562bb97-8d8e-4929-aa42-c8b5fb8748f4 None None] MFA Rules not processed for user `c8bc6ac1df7f4bd383fded2b9a22ecf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:21.070859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f562bb97-8d8e-4929-aa42-c8b5fb8748f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:21.135121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1115/2246] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:26:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:21.150968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c248bc9-4491-462f-b677-01d2c9175f17 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:21.154021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0c248bc9-4491-462f-b677-01d2c9175f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:21.177331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c248bc9-4491-462f-b677-01d2c9175f17 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:21.182890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb2f5-77a8-43ed-964d-0306edc8664a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:21.183557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb2f5-77a8-43ed-964d-0306edc8664a service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:21.183834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb2f5-77a8-43ed-964d-0306edc8664a service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:21.184130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb2f5-77a8-43ed-964d-0306edc8664a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:21.194663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb2f5-77a8-43ed-964d-0306edc8664a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:21.197202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb2f5-77a8-43ed-964d-0306edc8664a service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:21.205621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1132/2247] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:26:21.293870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5180b-05c7-4f17-8c1f-81e6bb608ab7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:21.294162 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5180b-05c7-4f17-8c1f-81e6bb608ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:21.294458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5180b-05c7-4f17-8c1f-81e6bb608ab7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:21.295789 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1116/2248] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:26:21.301309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a70cf4-4b83-4888-848d-8f2675f66763 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:21.301640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a70cf4-4b83-4888-848d-8f2675f66763 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:21.301923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a70cf4-4b83-4888-848d-8f2675f66763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:21.323324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f1a70cf4-4b83-4888-848d-8f2675f66763 None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:21.324628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f1a70cf4-4b83-4888-848d-8f2675f66763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:21.335341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1133/2249] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:26:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:21.346034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5180b-05c7-4f17-8c1f-81e6bb608ab7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:21.357661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5180b-05c7-4f17-8c1f-81e6bb608ab7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:21.361230 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9f5e-7033-4f75-967f-2e947043b9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:21.361855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9f5e-7033-4f75-967f-2e947043b9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:21.362139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9f5e-7033-4f75-967f-2e947043b9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:21.362417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a9f5e-7033-4f75-967f-2e947043b9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:21.373582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a9f5e-7033-4f75-967f-2e947043b9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:21.375010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a9f5e-7033-4f75-967f-2e947043b9a4 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:21.386340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1117/2250] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:26:24.777664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed9af-c444-49b4-81af-4289b18e04bf None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:24.778177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed9af-c444-49b4-81af-4289b18e04bf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:24.778385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed9af-c444-49b4-81af-4289b18e04bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:24.802402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b49ed9af-c444-49b4-81af-4289b18e04bf None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:24.803863 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b49ed9af-c444-49b4-81af-4289b18e04bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:24.813051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1134/2251] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:24.824986 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9f5e-7033-4f75-967f-2e947043b9a4 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:24.837405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a9f5e-7033-4f75-967f-2e947043b9a4 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:24.842443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb2f8-432b-4256-a519-45b7c343bfda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:24.843038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb2f8-432b-4256-a519-45b7c343bfda service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:24.843362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb2f8-432b-4256-a519-45b7c343bfda service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:24.843634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb2f8-432b-4256-a519-45b7c343bfda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:24.851625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb2f8-432b-4256-a519-45b7c343bfda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:24.853928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb2f8-432b-4256-a519-45b7c343bfda service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:24.862295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1118/2252] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:26:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:26:34.795696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=43 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:34.858753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=66 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:26:52.923611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e0208-4f8e-4b10-bfac-5e87ed884336 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:52.924166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e0208-4f8e-4b10-bfac-5e87ed884336 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:52.924166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e0208-4f8e-4b10-bfac-5e87ed884336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:52.944459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7e2e0208-4f8e-4b10-bfac-5e87ed884336 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:52.945744 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7e2e0208-4f8e-4b10-bfac-5e87ed884336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:52.954355 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1135/2253] 10.222.0.15 () {58 vars in 967 bytes} [Thu Oct 6 12:26:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:26:52.967110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb2f8-432b-4256-a519-45b7c343bfda service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:26:52.977617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb2f8-432b-4256-a519-45b7c343bfda service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:26:52.983139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ef06a-02d8-40a0-853e-696f4d9a4f71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:26:52.983741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ef06a-02d8-40a0-853e-696f4d9a4f71 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:52.984025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ef06a-02d8-40a0-853e-696f4d9a4f71 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:52.984303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ef06a-02d8-40a0-853e-696f4d9a4f71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:52.992567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ef06a-02d8-40a0-853e-696f4d9a4f71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:26:52.994765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ef06a-02d8-40a0-853e-696f4d9a4f71 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:26:53.002896 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1119/2254] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:26:58.667286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4c71-e8e5-41f0-93ee-bf2c7786e899 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:26:58.667888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4c71-e8e5-41f0-93ee-bf2c7786e899 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:26:58.667888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4c71-e8e5-41f0-93ee-bf2c7786e899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:26:58.687305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-974e4c71-e8e5-41f0-93ee-bf2c7786e899 None None] MFA Rules not processed for user `6e85dd23d9a54ce49ac9e3dd4f478a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:26:58.688500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-974e4c71-e8e5-41f0-93ee-bf2c7786e899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:26:58.743172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1136/2255] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:26:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:27:02.999623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:08.736448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=28 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:16.351373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0b72-effc-4150-9ae0-6d6ec6114526 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:16.351939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0b72-effc-4150-9ae0-6d6ec6114526 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:16.351939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0b72-effc-4150-9ae0-6d6ec6114526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:16.373050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-424e0b72-effc-4150-9ae0-6d6ec6114526 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:27:16.374362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-424e0b72-effc-4150-9ae0-6d6ec6114526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:16.382714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1120/2256] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:27:16.405501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e4c71-e8e5-41f0-93ee-bf2c7786e899 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:27:16.418730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e4c71-e8e5-41f0-93ee-bf2c7786e899 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:27:16.424184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e32dfc-8122-4cf7-83a6-5536d1b11920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:27:16.424788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e32dfc-8122-4cf7-83a6-5536d1b11920 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:16.425075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e32dfc-8122-4cf7-83a6-5536d1b11920 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:16.425352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e32dfc-8122-4cf7-83a6-5536d1b11920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:16.434880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e32dfc-8122-4cf7-83a6-5536d1b11920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:27:16.436475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e32dfc-8122-4cf7-83a6-5536d1b11920 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:27:16.446330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1137/2257] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:27:20.655083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d2456-39b9-4bba-845d-6a071b152d71 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:20.655664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d2456-39b9-4bba-845d-6a071b152d71 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:20.655664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d2456-39b9-4bba-845d-6a071b152d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:20.681922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0f6d2456-39b9-4bba-845d-6a071b152d71 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:27:20.683156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0f6d2456-39b9-4bba-845d-6a071b152d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:20.691165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1121/2258] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:27:20.714378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e32dfc-8122-4cf7-83a6-5536d1b11920 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:27:20.725773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e32dfc-8122-4cf7-83a6-5536d1b11920 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:27:20.732351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544ec7e-be15-41c3-83a9-38fa28a95f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:27:20.732955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544ec7e-be15-41c3-83a9-38fa28a95f1d service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:20.733231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544ec7e-be15-41c3-83a9-38fa28a95f1d service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:20.733501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544ec7e-be15-41c3-83a9-38fa28a95f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:20.742196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544ec7e-be15-41c3-83a9-38fa28a95f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:27:20.744401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544ec7e-be15-41c3-83a9-38fa28a95f1d service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:27:20.754522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1138/2259] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:27:23.779126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe28c8-3f61-44c1-8252-81fe62c10532 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:23.779670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe28c8-3f61-44c1-8252-81fe62c10532 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:23.779670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe28c8-3f61-44c1-8252-81fe62c10532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:23.801131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-31fe28c8-3f61-44c1-8252-81fe62c10532 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:27:23.802382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-31fe28c8-3f61-44c1-8252-81fe62c10532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:23.814847 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1122/2260] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:27:23.837786 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544ec7e-be15-41c3-83a9-38fa28a95f1d service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:27:23.849133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544ec7e-be15-41c3-83a9-38fa28a95f1d service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:27:23.854862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4690-7833-4e4f-bac4-a69759191457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:27:23.855478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4690-7833-4e4f-bac4-a69759191457 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:23.855761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4690-7833-4e4f-bac4-a69759191457 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:23.856030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b4690-7833-4e4f-bac4-a69759191457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:23.866137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b4690-7833-4e4f-bac4-a69759191457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:27:23.868882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b4690-7833-4e4f-bac4-a69759191457 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:27:23.886982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1139/2261] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:27:27.982046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b55039-29f7-41a2-bbee-4594a03c5d6c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:27.982724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b55039-29f7-41a2-bbee-4594a03c5d6c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:27.982724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b55039-29f7-41a2-bbee-4594a03c5d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:28.003732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-87b55039-29f7-41a2-bbee-4594a03c5d6c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:27:28.004964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-87b55039-29f7-41a2-bbee-4594a03c5d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:28.013888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1123/2262] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:27:28.033691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4690-7833-4e4f-bac4-a69759191457 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:27:28.045168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b4690-7833-4e4f-bac4-a69759191457 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:27:28.050858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d22b15-6aef-4920-9d3f-6cce62d9b635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:27:28.051455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d22b15-6aef-4920-9d3f-6cce62d9b635 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:28.051740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d22b15-6aef-4920-9d3f-6cce62d9b635 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:28.052015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d22b15-6aef-4920-9d3f-6cce62d9b635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:28.061081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d22b15-6aef-4920-9d3f-6cce62d9b635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:27:28.062712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d22b15-6aef-4920-9d3f-6cce62d9b635 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:27:28.073235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1140/2263] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:27:33.250446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10349-1677-40f8-a560-f847ad4d4aff None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:33.251034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10349-1677-40f8-a560-f847ad4d4aff None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:33.251034 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10349-1677-40f8-a560-f847ad4d4aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:33.272395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-98f10349-1677-40f8-a560-f847ad4d4aff None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:27:33.273684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98f10349-1677-40f8-a560-f847ad4d4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:33.281619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1124/2264] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Oct 6 12:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:27:33.303196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d22b15-6aef-4920-9d3f-6cce62d9b635 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:27:33.315746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d22b15-6aef-4920-9d3f-6cce62d9b635 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:27:33.321954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f73b2-17ee-4530-923d-87fc731ffb6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:27:33.322555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f73b2-17ee-4530-923d-87fc731ffb6d service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:33.322831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f73b2-17ee-4530-923d-87fc731ffb6d service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:33.323103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f73b2-17ee-4530-923d-87fc731ffb6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:33.331899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f73b2-17ee-4530-923d-87fc731ffb6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:27:33.333471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f73b2-17ee-4530-923d-87fc731ffb6d service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:27:33.343237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1141/2265] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:27:35.891695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bce41-ef3c-420f-b3f3-d0655bfc96d7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:35.891695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bce41-ef3c-420f-b3f3-d0655bfc96d7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:35.891695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bce41-ef3c-420f-b3f3-d0655bfc96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:35.908460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d77bce41-ef3c-420f-b3f3-d0655bfc96d7 None None] MFA Rules not processed for user `f4a9da2cec0d420b800b99797166893f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:27:35.909693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d77bce41-ef3c-420f-b3f3-d0655bfc96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:35.970193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1125/2266] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:27:39.797461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f73b2-17ee-4530-923d-87fc731ffb6d service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:27:39.802263 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=31 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:39.809012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f73b2-17ee-4530-923d-87fc731ffb6d service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:27:39.812628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:27:39.813219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:39.813496 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:39.813805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:39.815488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:39.828995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:27:39.830437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:27:39.842089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1142/2267] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:27:41.026428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bce41-ef3c-420f-b3f3-d0655bfc96d7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:27:41.027961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d77bce41-ef3c-420f-b3f3-d0655bfc96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:41.041071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bce41-ef3c-420f-b3f3-d0655bfc96d7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:27:41.044682 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:27:41.045281 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:27:41.045584 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:27:41.045860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:27:41.047591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:27:41.062078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:27:41.063499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:27:41.074763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1126/2268] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:27:49.836940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:27:51.069949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=46 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:01.866600 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:01.875200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d808f9d-c64b-47f4-9657-93593740609f service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:01.879145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb384ad-efc9-4829-9a26-2c4a47a2b3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:01.879769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb384ad-efc9-4829-9a26-2c4a47a2b3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:01.880071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb384ad-efc9-4829-9a26-2c4a47a2b3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:01.880343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb384ad-efc9-4829-9a26-2c4a47a2b3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:01.882605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-beb384ad-efc9-4829-9a26-2c4a47a2b3c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:01.894049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb384ad-efc9-4829-9a26-2c4a47a2b3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:01.895462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb384ad-efc9-4829-9a26-2c4a47a2b3c8 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:01.905324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1143/2269] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:28:01.983224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:01.994413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af43c0-8608-4ad7-9b27-be6456582eee service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:01.999884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:02.000487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:02.000775 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:02.001043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:02.002822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:02.075995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:02.077640 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:02.088519 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1127/2270] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:28:03.098093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089da8-eb5d-42ef-ac7c-5b6ed604b910 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:03.098695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089da8-eb5d-42ef-ac7c-5b6ed604b910 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:03.098851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089da8-eb5d-42ef-ac7c-5b6ed604b910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:03.120992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0a089da8-eb5d-42ef-ac7c-5b6ed604b910 None None] MFA Rules not processed for user `57d8dd7c820144a082032626cb481df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:03.122269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0a089da8-eb5d-42ef-ac7c-5b6ed604b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:03.129621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1144/2271] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:28:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:28:03.472853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:03.483938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57335c-4a8b-43bc-bef1-7dd2510de7c2 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:03.487461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:03.488054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:03.488335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:03.488609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:03.491028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:03.502079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:03.503496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:03.514358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1128/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:28:03.859351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089da8-eb5d-42ef-ac7c-5b6ed604b910 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:03.861361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0a089da8-eb5d-42ef-ac7c-5b6ed604b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:03.887861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089da8-eb5d-42ef-ac7c-5b6ed604b910 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:03.903387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62c054-fadb-4867-a682-b9987e4eb4d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:03.904011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c054-fadb-4867-a682-b9987e4eb4d4 service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:03.904297 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c054-fadb-4867-a682-b9987e4eb4d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:03.904576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c054-fadb-4867-a682-b9987e4eb4d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:03.906832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8a62c054-fadb-4867-a682-b9987e4eb4d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:03.922628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62c054-fadb-4867-a682-b9987e4eb4d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:03.924371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62c054-fadb-4867-a682-b9987e4eb4d4 service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:03.934975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1145/2273] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:28:08.264932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:08.279013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d2de1-435b-480a-8aaf-8273fb2fe153 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:08.284215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa2d8-4de7-499c-ab42-452ef03e0691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:08.285271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa2d8-4de7-499c-ab42-452ef03e0691 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:08.285873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa2d8-4de7-499c-ab42-452ef03e0691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:08.287084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa2d8-4de7-499c-ab42-452ef03e0691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:08.290899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-695fa2d8-4de7-499c-ab42-452ef03e0691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:08.303628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fa2d8-4de7-499c-ab42-452ef03e0691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:08.304939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fa2d8-4de7-499c-ab42-452ef03e0691 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:08.317064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1129/2274] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:28:10.870716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f515da-3c2e-4f8d-8196-23dddfe4161f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:10.871244 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f515da-3c2e-4f8d-8196-23dddfe4161f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:10.871363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f515da-3c2e-4f8d-8196-23dddfe4161f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:10.892797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-04f515da-3c2e-4f8d-8196-23dddfe4161f None None] MFA Rules not processed for user `124d46b9c4d94ddfac10753c766b52b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:10.894170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-04f515da-3c2e-4f8d-8196-23dddfe4161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:10.902862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1146/2275] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:28:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:14.065615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae5b0-e0a5-4e9b-a947-ed86c667217c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:14.066523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae5b0-e0a5-4e9b-a947-ed86c667217c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:14.066809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae5b0-e0a5-4e9b-a947-ed86c667217c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:14.070350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1130/2276] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:28:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:28:14.115795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a6b9-9ad9-48fa-9b8c-3d41f81cb474 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:14.116761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a6b9-9ad9-48fa-9b8c-3d41f81cb474 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:14.117128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a6b9-9ad9-48fa-9b8c-3d41f81cb474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:14.143469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-30c0a6b9-9ad9-48fa-9b8c-3d41f81cb474 None None] MFA Rules not processed for user `e3188514d47747c0ae22b9b35cf3c274`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:14.145064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-30c0a6b9-9ad9-48fa-9b8c-3d41f81cb474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:14.158269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1147/2277] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:14.183270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae5b0-e0a5-4e9b-a947-ed86c667217c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:14.185140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c74ae5b0-e0a5-4e9b-a947-ed86c667217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:14.187424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a6b9-9ad9-48fa-9b8c-3d41f81cb474 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:14.202106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a6b9-9ad9-48fa-9b8c-3d41f81cb474 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:14.217105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae5b0-e0a5-4e9b-a947-ed86c667217c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:14.222795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c5df8-5f03-4232-bb27-c68300b2441f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:14.223894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5df8-5f03-4232-bb27-c68300b2441f service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:14.224342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5df8-5f03-4232-bb27-c68300b2441f service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:14.224959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5df8-5f03-4232-bb27-c68300b2441f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:14.233865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:14.234884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:14.235437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:14.235593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] PATH_INFO: `/v3/users/6e85dd23d9a54ce49ac9e3dd4f478a12` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:14.242168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e85dd23d9a54ce49ac9e3dd4f478a12)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:14.244165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:14.257507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c5df8-5f03-4232-bb27-c68300b2441f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:14.259145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c5df8-5f03-4232-bb27-c68300b2441f service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:14.269987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1148/2278] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:28:14.316705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e85dd23d9a54ce49ac9e3dd4f478a12'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.318107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e85dd23d9a54ce49ac9e3dd4f478a12'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.326998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e85dd23d9a54ce49ac9e3dd4f478a12'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.339960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e85dd23d9a54ce49ac9e3dd4f478a12'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.347344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3591fa96-497d-44a0-8020-424fbd21046d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e85dd23d9a54ce49ac9e3dd4f478a12'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.353844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1131/2279] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:28:14 2022] DELETE /identity/v3/users/6e85dd23d9a54ce49ac9e3dd4f478a12 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:28:14.550689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c5df8-5f03-4232-bb27-c68300b2441f service placement] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:14.572166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c5df8-5f03-4232-bb27-c68300b2441f service placement] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:14.653594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:14.654659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:14.655008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:14.655345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] PATH_INFO: `/v3/projects/7d5563aa54de48a1aac069dacae4fc05` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:14.656728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5563aa54de48a1aac069dacae4fc05)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:14.658811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:14.722271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5563aa54de48a1aac069dacae4fc05', 'request_id': 'req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.731171 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5563aa54de48a1aac069dacae4fc05', 'request_id': 'req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.738036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5563aa54de48a1aac069dacae4fc05', 'request_id': 'req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.753015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] The token cache is being invalidate because project 7d5563aa54de48a1aac069dacae4fc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:28:14.753621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.754966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c0d18588-a2ea-410c-ae46-bb8ff4cbf033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:28:14.761798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1149/2280] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:28:14 2022] DELETE /identity/v3/projects/7d5563aa54de48a1aac069dacae4fc05 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:28:14.763414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9051c3f-81f2-4843-8988-82b40435957b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:14.763871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9051c3f-81f2-4843-8988-82b40435957b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:14.764335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9051c3f-81f2-4843-8988-82b40435957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:14.790148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c9051c3f-81f2-4843-8988-82b40435957b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:14.791901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c9051c3f-81f2-4843-8988-82b40435957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:14.853093 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:14.909895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1132/2281] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:14.918445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f26e4-09f3-4ac0-89a7-30fe4ca18c0e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:14.918756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f26e4-09f3-4ac0-89a7-30fe4ca18c0e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:14.921415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f26e4-09f3-4ac0-89a7-30fe4ca18c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:14.956383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-190f26e4-09f3-4ac0-89a7-30fe4ca18c0e None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:14.958944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-190f26e4-09f3-4ac0-89a7-30fe4ca18c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:14.967769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1150/2282] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:14.972321 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9051c3f-81f2-4843-8988-82b40435957b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:14.983790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9051c3f-81f2-4843-8988-82b40435957b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:14.990774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:14.991437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:14.991905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:14.992431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:14.993289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:28:14.993636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:14.995275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:15.011285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1133/2283] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:28:15.015899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f26e4-09f3-4ac0-89a7-30fe4ca18c0e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:15.031689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f26e4-09f3-4ac0-89a7-30fe4ca18c0e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:15.038478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5215-6b10-4373-8f09-ce368e52eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:15.039103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5215-6b10-4373-8f09-ce368e52eb60 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:15.039383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5215-6b10-4373-8f09-ce368e52eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:15.039654 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc5215-6b10-4373-8f09-ce368e52eb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:15.040502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc5215-6b10-4373-8f09-ce368e52eb60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:15.042832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc5215-6b10-4373-8f09-ce368e52eb60 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:15.088279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1151/2284] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:28:15 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:28:15.089472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:15.101201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7cbe-1c3d-4f15-9694-e06b34a13a22 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:15.172833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd10d5-cd91-4ab3-800f-0c95268069b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:15.173454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd10d5-cd91-4ab3-800f-0c95268069b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:15.173782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd10d5-cd91-4ab3-800f-0c95268069b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:15.174052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd10d5-cd91-4ab3-800f-0c95268069b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:15.174702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd10d5-cd91-4ab3-800f-0c95268069b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:15.176652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd10d5-cd91-4ab3-800f-0c95268069b9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:15.204608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1134/2285] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:28:15 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:28:15.205815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5215-6b10-4373-8f09-ce368e52eb60 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:15.212233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:15.218949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc5215-6b10-4373-8f09-ce368e52eb60 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:15.226646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f7cd5-ad89-49fb-ad38-45b36315b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:15.227460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f7cd5-ad89-49fb-ad38-45b36315b074 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:15.227731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f7cd5-ad89-49fb-ad38-45b36315b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:15.227999 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f7cd5-ad89-49fb-ad38-45b36315b074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:15.228646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f7cd5-ad89-49fb-ad38-45b36315b074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:15.230663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f7cd5-ad89-49fb-ad38-45b36315b074 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:15.241611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1152/2286] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:28:15.245511 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd10d5-cd91-4ab3-800f-0c95268069b9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:15.256369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd10d5-cd91-4ab3-800f-0c95268069b9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:15.261193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175e9b-c552-4e1c-9c7f-4ebc3b8866bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:15.261849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175e9b-c552-4e1c-9c7f-4ebc3b8866bb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:15.262125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175e9b-c552-4e1c-9c7f-4ebc3b8866bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:15.262403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175e9b-c552-4e1c-9c7f-4ebc3b8866bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:15.263065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50175e9b-c552-4e1c-9c7f-4ebc3b8866bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:15.264698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50175e9b-c552-4e1c-9c7f-4ebc3b8866bb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:15.280767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1135/2287] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:28:15.281886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f7cd5-ad89-49fb-ad38-45b36315b074 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:15.292759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f7cd5-ad89-49fb-ad38-45b36315b074 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:15.298140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:15.298803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:15.299308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:15.299575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] PATH_INFO: `/v3/projects/e853ba960c00478e80988ea1f71532e2/users/5db54e523d0f41c29b5da5ec093237bd/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:15.315880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e853ba960c00478e80988ea1f71532e2, user_id=5db54e523d0f41c29b5da5ec093237bd, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:15.319211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:15.341848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1153/2288] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:28:15 2022] PUT /identity/v3/projects/e853ba960c00478e80988ea1f71532e2/users/5db54e523d0f41c29b5da5ec093237bd/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:28:15.345201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74e8fd-8bda-4505-9064-d8adaec8cc64 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:15.345499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74e8fd-8bda-4505-9064-d8adaec8cc64 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:15.345824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74e8fd-8bda-4505-9064-d8adaec8cc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:15.366172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cc74e8fd-8bda-4505-9064-d8adaec8cc64 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:15.367425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cc74e8fd-8bda-4505-9064-d8adaec8cc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:15.430172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1136/2289] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:28:15.440266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:15.442720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:15.502374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd4d2c-df7b-4fbb-acea-2e98908cf3be admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:15.507077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda810-2a50-478d-8127-b4ef63df822b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:15.507707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda810-2a50-478d-8127-b4ef63df822b service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:15.507985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda810-2a50-478d-8127-b4ef63df822b service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:15.508256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda810-2a50-478d-8127-b4ef63df822b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:15.518219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda810-2a50-478d-8127-b4ef63df822b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:15.519693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda810-2a50-478d-8127-b4ef63df822b service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:15.532323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1154/2290] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:28:20.541239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20c6a-d151-4337-bf52-fd94a8d424b4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:20.541857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20c6a-d151-4337-bf52-fd94a8d424b4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:20.541857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20c6a-d151-4337-bf52-fd94a8d424b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:20.575934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-46f20c6a-d151-4337-bf52-fd94a8d424b4 None None] MFA Rules not processed for user `5db54e523d0f41c29b5da5ec093237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:20.577203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-46f20c6a-d151-4337-bf52-fd94a8d424b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:20.630777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:20.703121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1137/2291] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:20.707648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda810-2a50-478d-8127-b4ef63df822b service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:20.726952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda810-2a50-478d-8127-b4ef63df822b service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:20.732926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9df1e-220e-466e-8ae3-c53bc644f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:20.733788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9df1e-220e-466e-8ae3-c53bc644f971 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:20.734264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9df1e-220e-466e-8ae3-c53bc644f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:20.734706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9df1e-220e-466e-8ae3-c53bc644f971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:20.735579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9df1e-220e-466e-8ae3-c53bc644f971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:20.737772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9df1e-220e-466e-8ae3-c53bc644f971 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:20.796462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1155/2292] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:28:20 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:28:20.800303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f20c6a-d151-4337-bf52-fd94a8d424b4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:20.813633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f20c6a-d151-4337-bf52-fd94a8d424b4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:20.881212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b8f53-8537-4ed6-bfaa-938d63ee6301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:20.881926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8f53-8537-4ed6-bfaa-938d63ee6301 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:20.882797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8f53-8537-4ed6-bfaa-938d63ee6301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:20.883084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8f53-8537-4ed6-bfaa-938d63ee6301 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:20.883748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b8f53-8537-4ed6-bfaa-938d63ee6301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:20.886393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b8f53-8537-4ed6-bfaa-938d63ee6301 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:20.915900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1138/2293] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:28:20 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:28:20.917374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9df1e-220e-466e-8ae3-c53bc644f971 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:20.930330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9df1e-220e-466e-8ae3-c53bc644f971 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:20.936905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500796-f2b0-4242-b672-c3858914bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:20.937724 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500796-f2b0-4242-b672-c3858914bd05 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:20.938365 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500796-f2b0-4242-b672-c3858914bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:20.938721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500796-f2b0-4242-b672-c3858914bd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:20.939502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2500796-f2b0-4242-b672-c3858914bd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:20.942135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2500796-f2b0-4242-b672-c3858914bd05 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:20.979196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1156/2294] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:28:20.980349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b8f53-8537-4ed6-bfaa-938d63ee6301 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:21.008518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b8f53-8537-4ed6-bfaa-938d63ee6301 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:21.018618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12ce5-9504-45e1-ad5d-b034d2f0de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:21.019299 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12ce5-9504-45e1-ad5d-b034d2f0de3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:21.020140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12ce5-9504-45e1-ad5d-b034d2f0de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:21.020449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12ce5-9504-45e1-ad5d-b034d2f0de3a admin admin] PATH_INFO: `/v3/projects/be794fb3962b4e3ca6fa8eecad7a2815/users/bde2a78e7e4c48ddbf148930a5b21032/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:21.046551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e12ce5-9504-45e1-ad5d-b034d2f0de3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be794fb3962b4e3ca6fa8eecad7a2815, user_id=bde2a78e7e4c48ddbf148930a5b21032, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:21.049418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e12ce5-9504-45e1-ad5d-b034d2f0de3a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:21.073574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1139/2295] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:28:20 2022] PUT /identity/v3/projects/be794fb3962b4e3ca6fa8eecad7a2815/users/bde2a78e7e4c48ddbf148930a5b21032/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:28:21.074758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500796-f2b0-4242-b672-c3858914bd05 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:21.086173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500796-f2b0-4242-b672-c3858914bd05 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:21.196688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:21.197958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:21.198354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:21.198745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:21.200149 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:21.202510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:21.222710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1157/2296] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:28:21.224426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12ce5-9504-45e1-ad5d-b034d2f0de3a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:21.240712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12ce5-9504-45e1-ad5d-b034d2f0de3a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:21.249214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c4d2-12c4-4451-8c5f-c967d6d6e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:21.250011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c4d2-12c4-4451-8c5f-c967d6d6e984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:21.250300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c4d2-12c4-4451-8c5f-c967d6d6e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:21.250574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c4d2-12c4-4451-8c5f-c967d6d6e984 admin admin] PATH_INFO: `/v3/projects/be794fb3962b4e3ca6fa8eecad7a2815/users/bde2a78e7e4c48ddbf148930a5b21032/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:21.252878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6c4d2-12c4-4451-8c5f-c967d6d6e984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be794fb3962b4e3ca6fa8eecad7a2815, user_id=bde2a78e7e4c48ddbf148930a5b21032, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:21.256541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6c4d2-12c4-4451-8c5f-c967d6d6e984 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:21.273882 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1140/2297] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:28:21 2022] PUT /identity/v3/projects/be794fb3962b4e3ca6fa8eecad7a2815/users/bde2a78e7e4c48ddbf148930a5b21032/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:28:21.542692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:21.544567 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:21.603415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:21.679959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ffca-e4ed-411a-a334-ea3aba6cd089 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:21.783913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f5e60-db58-4e68-b6a1-31d21feacc7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:21.784578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5e60-db58-4e68-b6a1-31d21feacc7a service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:21.784873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5e60-db58-4e68-b6a1-31d21feacc7a service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:21.786161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5e60-db58-4e68-b6a1-31d21feacc7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:21.788217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-571f5e60-db58-4e68-b6a1-31d21feacc7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:21.802003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5e60-db58-4e68-b6a1-31d21feacc7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:21.803847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5e60-db58-4e68-b6a1-31d21feacc7a service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:21.817354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1158/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:28:25.786112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c4d2-12c4-4451-8c5f-c967d6d6e984 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:25.800167 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c4d2-12c4-4451-8c5f-c967d6d6e984 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:25.806950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:25.807719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:25.808006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:25.808451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:25.810634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:25.827485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:25.829115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:25.844367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1141/2299] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:28:27.746376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7a04d-b08a-4e20-8b09-ef5e7f7f6dee None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:27.747404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7a04d-b08a-4e20-8b09-ef5e7f7f6dee None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:27.747928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7a04d-b08a-4e20-8b09-ef5e7f7f6dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:27.785369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-d3b7a04d-b08a-4e20-8b09-ef5e7f7f6dee None None] MFA Rules not processed for user `bde2a78e7e4c48ddbf148930a5b21032`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:27.786642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d3b7a04d-b08a-4e20-8b09-ef5e7f7f6dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:27.860110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1159/2300] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:28:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:27.876223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:27.877838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:27.941743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29840fa-fa32-471b-b2f1-96b4444c2032 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:27.945452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:27.946099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:27.946378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:27.946651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:27.982714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:28.010655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:28.012027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:28.021308 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1142/2301] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:28:28.158875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d90ab-87b4-41c0-8521-b8e932e3d787 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:28.159290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d90ab-87b4-41c0-8521-b8e932e3d787 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:28.160134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d90ab-87b4-41c0-8521-b8e932e3d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:28.181677 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a84d90ab-87b4-41c0-8521-b8e932e3d787 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:28.182889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a84d90ab-87b4-41c0-8521-b8e932e3d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:28.224586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:28.243409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1160/2302] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:28:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:28.299159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:28.301574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:28.371604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846df0b-93e9-42a3-9684-b0adbb15fee8 service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:28.376789 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b371c7-eaeb-4cd6-bea7-ae2f053fe880 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:28.377404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b371c7-eaeb-4cd6-bea7-ae2f053fe880 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:28.377723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b371c7-eaeb-4cd6-bea7-ae2f053fe880 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:28.378003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b371c7-eaeb-4cd6-bea7-ae2f053fe880 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:28.387108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b371c7-eaeb-4cd6-bea7-ae2f053fe880 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:28.388702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b371c7-eaeb-4cd6-bea7-ae2f053fe880 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:28.398367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1143/2303] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:28:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:28:37.048871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67543a-2eaa-4ddf-b0cf-25ed516519f1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:37.049466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67543a-2eaa-4ddf-b0cf-25ed516519f1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:37.049466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67543a-2eaa-4ddf-b0cf-25ed516519f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:37.069314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-aa67543a-2eaa-4ddf-b0cf-25ed516519f1 None None] MFA Rules not processed for user `5db54e523d0f41c29b5da5ec093237bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:37.070537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-aa67543a-2eaa-4ddf-b0cf-25ed516519f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:37.077398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1161/2304] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:28:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:38.393877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=44 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:39.342828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb9cc7-055b-4d42-81b9-06637223b73f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:39.343147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb9cc7-055b-4d42-81b9-06637223b73f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:39.343425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb9cc7-055b-4d42-81b9-06637223b73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:39.365849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e4fb9cc7-055b-4d42-81b9-06637223b73f None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:28:39.367921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e4fb9cc7-055b-4d42-81b9-06637223b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:39.378651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1144/2305] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:28:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:28:39.396414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67543a-2eaa-4ddf-b0cf-25ed516519f1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:39.410305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67543a-2eaa-4ddf-b0cf-25ed516519f1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:39.416524 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3dfe7-53fa-4014-bf50-56ba635c1161 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:39.417143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3dfe7-53fa-4014-bf50-56ba635c1161 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:39.417427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3dfe7-53fa-4014-bf50-56ba635c1161 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:39.417734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3dfe7-53fa-4014-bf50-56ba635c1161 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:39.427661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3dfe7-53fa-4014-bf50-56ba635c1161 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:39.429300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3dfe7-53fa-4014-bf50-56ba635c1161 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:39.437890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1162/2306] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:28:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:28:45.643504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb9cc7-055b-4d42-81b9-06637223b73f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:45.645569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e4fb9cc7-055b-4d42-81b9-06637223b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:45.703213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb9cc7-055b-4d42-81b9-06637223b73f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:45.706838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:45.707963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:45.708245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:45.708518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:45.710328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:45.775695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:45.777135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:45.787482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1145/2307] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:28:49.434294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=15 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:28:51.257214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3dfe7-53fa-4014-bf50-56ba635c1161 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:28:51.266939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3dfe7-53fa-4014-bf50-56ba635c1161 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:28:51.271156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b153ec5-d78f-43c7-81f1-fcc005a22e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:28:51.271741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b153ec5-d78f-43c7-81f1-fcc005a22e11 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:28:51.272015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b153ec5-d78f-43c7-81f1-fcc005a22e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:28:51.272283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b153ec5-d78f-43c7-81f1-fcc005a22e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:28:51.274012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2b153ec5-d78f-43c7-81f1-fcc005a22e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:28:51.333718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b153ec5-d78f-43c7-81f1-fcc005a22e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:28:51.335174 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b153ec5-d78f-43c7-81f1-fcc005a22e11 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:28:51.344710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1163/2308] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:28:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:28:55.782247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=51 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:01.340139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=28 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:05.186303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:05.188023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:05.218619 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efade55f-9e47-407f-ab60-2a71b75510c4 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:05.238739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:05.239744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:05.240236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:05.241018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:05.243380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:05.260192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:05.263228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:05.285914 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1146/2309] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:08.088807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf103-4707-4fcb-83d0-2d43ac0f187c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:08.089519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf103-4707-4fcb-83d0-2d43ac0f187c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:08.089519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf103-4707-4fcb-83d0-2d43ac0f187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:08.115845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-83dcf103-4707-4fcb-83d0-2d43ac0f187c None None] MFA Rules not processed for user `8f1e7d78567844e4a1fa2d969a4f4821`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:08.117133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-83dcf103-4707-4fcb-83d0-2d43ac0f187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:08.130998 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1164/2310] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:08.578319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:08.580036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:08.647228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769040e5-84a9-493c-9074-5a00aa2e5bc0 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:08.650952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:08.651567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:08.651855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:08.652134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:08.653998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:08.666004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:08.667646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:08.686590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1147/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:14.789584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcf103-4707-4fcb-83d0-2d43ac0f187c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:14.803307 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcf103-4707-4fcb-83d0-2d43ac0f187c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:14.808233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:14.809867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:14.810382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:14.810861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:14.833873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:14.837527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:14.864459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1165/2312] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:18.673786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=32 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:24.852447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=9 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:25.271652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:25.280315 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b41f3-91d7-4ce8-bc5a-307b90e65a73 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:25.284163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:25.284764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:25.285049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:25.285325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:25.287104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:25.351642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:25.353080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:25.363600 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1148/2313] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:28.965413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:28.966873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:29.040176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:29.041730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:29.041885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de9ef3-3846-423b-a3b5-beb048d69729 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.046976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.047640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.047926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.048771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.050604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:29.056163 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d499a4-48d8-4aa4-9909-51cedb470cbc service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.062040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.062989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.063228 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.063340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.063538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] PATH_INFO: `/v3/users/f4a9da2cec0d420b800b99797166893f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.065401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a9da2cec0d420b800b99797166893f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.065525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.067400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.077111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1166/2314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:29.137953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a9da2cec0d420b800b99797166893f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.138926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a9da2cec0d420b800b99797166893f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.148331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a9da2cec0d420b800b99797166893f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.162183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a9da2cec0d420b800b99797166893f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.169667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0f21baf6-8fe6-481a-9b3c-ca3fbb220b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a9da2cec0d420b800b99797166893f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.176694 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1149/2315] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:29:29 2022] DELETE /identity/v3/users/f4a9da2cec0d420b800b99797166893f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:29.362692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:29.375305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085c4e-d3bf-4c03-9fd2-2b54cfbdc64f service placement] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.447900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.448537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.448818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.449093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] PATH_INFO: `/v3/projects/7902bf921664442cab21a7d97cbcf911` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.450203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7902bf921664442cab21a7d97cbcf911)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.452114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.498378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7902bf921664442cab21a7d97cbcf911', 'request_id': 'req-93a4344f-3088-403f-b298-33874040df87'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.504606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7902bf921664442cab21a7d97cbcf911', 'request_id': 'req-93a4344f-3088-403f-b298-33874040df87'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.510054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7902bf921664442cab21a7d97cbcf911', 'request_id': 'req-93a4344f-3088-403f-b298-33874040df87'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.522679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] The token cache is being invalidate because project 7902bf921664442cab21a7d97cbcf911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:29:29.522973 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.523602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-93a4344f-3088-403f-b298-33874040df87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:29.525088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1167/2316] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:29:29 2022] DELETE /identity/v3/projects/7902bf921664442cab21a7d97cbcf911 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:29.530488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970e77-99cd-473c-af86-7193f35519f3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.530760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970e77-99cd-473c-af86-7193f35519f3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.531026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970e77-99cd-473c-af86-7193f35519f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.551844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6b970e77-99cd-473c-af86-7193f35519f3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:29.553049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6b970e77-99cd-473c-af86-7193f35519f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:29.610017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1150/2317] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:29:29.618477 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63f122-235f-49b0-817b-95ca0756af43 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.618963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63f122-235f-49b0-817b-95ca0756af43 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.619267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63f122-235f-49b0-817b-95ca0756af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.640154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-4e63f122-235f-49b0-817b-95ca0756af43 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:29.641363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4e63f122-235f-49b0-817b-95ca0756af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:29.649235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1168/2318] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:29.653454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970e77-99cd-473c-af86-7193f35519f3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:29.663803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970e77-99cd-473c-af86-7193f35519f3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.668382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.668977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.669260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.669554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.670207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:29:29.670512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.672138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.674404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:29.685965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1151/2319] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:29:29.689987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63f122-235f-49b0-817b-95ca0756af43 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:29.699342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63f122-235f-49b0-817b-95ca0756af43 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.703929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab599b-310b-4668-adb6-baf44f148f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.704523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab599b-310b-4668-adb6-baf44f148f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.704829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab599b-310b-4668-adb6-baf44f148f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.705147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab599b-310b-4668-adb6-baf44f148f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.706099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab599b-310b-4668-adb6-baf44f148f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.707723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab599b-310b-4668-adb6-baf44f148f54 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.718857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:29.736728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1169/2320] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:29:29 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:29:29.740971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:29.751485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5e358-2e0f-4266-b9e7-48ca4883c23c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.831937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359912f-4584-40a3-aff2-bf3e116653fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.832555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359912f-4584-40a3-aff2-bf3e116653fd admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.832848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359912f-4584-40a3-aff2-bf3e116653fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.833126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359912f-4584-40a3-aff2-bf3e116653fd admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.833808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359912f-4584-40a3-aff2-bf3e116653fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.835799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359912f-4584-40a3-aff2-bf3e116653fd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.858456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1152/2321] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:29:29 2022] POST /identity/v3/users => generated 282 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:29.863223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab599b-310b-4668-adb6-baf44f148f54 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:29.873257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab599b-310b-4668-adb6-baf44f148f54 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.877779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc0eff-e5f7-4b7d-9848-3dae17d804c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.878355 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0eff-e5f7-4b7d-9848-3dae17d804c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.878646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0eff-e5f7-4b7d-9848-3dae17d804c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.878902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0eff-e5f7-4b7d-9848-3dae17d804c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.879537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc0eff-e5f7-4b7d-9848-3dae17d804c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.881106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc0eff-e5f7-4b7d-9848-3dae17d804c1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.891360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1170/2322] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:29.895813 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359912f-4584-40a3-aff2-bf3e116653fd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:29.905695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359912f-4584-40a3-aff2-bf3e116653fd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.911517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8983789-3560-430c-8128-aa2c30a49500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.912116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983789-3560-430c-8128-aa2c30a49500 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.912401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983789-3560-430c-8128-aa2c30a49500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.912677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983789-3560-430c-8128-aa2c30a49500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.913333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8983789-3560-430c-8128-aa2c30a49500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.914966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8983789-3560-430c-8128-aa2c30a49500 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.925984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1153/2323] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:29.930130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc0eff-e5f7-4b7d-9848-3dae17d804c1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:29.940037 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc0eff-e5f7-4b7d-9848-3dae17d804c1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:29.944622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:29.945270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.945572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.945879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] PATH_INFO: `/v3/projects/af15846f6d684d0ab10073acd25e8c6a/users/e760aee57215478ab8c0638faca81eae/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:29.960918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af15846f6d684d0ab10073acd25e8c6a, user_id=e760aee57215478ab8c0638faca81eae, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:29.963614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:29.976900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1171/2324] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:29 2022] PUT /identity/v3/projects/af15846f6d684d0ab10073acd25e8c6a/users/e760aee57215478ab8c0638faca81eae/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:29.987876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fde18-b523-41d7-800a-0faab4f4956a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:29.988164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fde18-b523-41d7-800a-0faab4f4956a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:29.988435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fde18-b523-41d7-800a-0faab4f4956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:30.016398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-032fde18-b523-41d7-800a-0faab4f4956a None None] MFA Rules not processed for user `e760aee57215478ab8c0638faca81eae`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:30.018154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-032fde18-b523-41d7-800a-0faab4f4956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:30.080819 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1154/2325] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:30.091738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:30.093647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:30.159604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc8282-bb4c-47bb-9878-db690476f437 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:30.163240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98e8f-df79-4f74-b1dd-1d24cbba0e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:30.163846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98e8f-df79-4f74-b1dd-1d24cbba0e70 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:30.164116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98e8f-df79-4f74-b1dd-1d24cbba0e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:30.164383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98e8f-df79-4f74-b1dd-1d24cbba0e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:30.172881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98e8f-df79-4f74-b1dd-1d24cbba0e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:30.174591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98e8f-df79-4f74-b1dd-1d24cbba0e70 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:30.183320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1172/2326] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:38.648144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fde18-b523-41d7-800a-0faab4f4956a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:38.711145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fde18-b523-41d7-800a-0faab4f4956a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:38.715644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:38.716271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:38.716554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:38.716831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] PATH_INFO: `/v3/users/e760aee57215478ab8c0638faca81eae` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:38.717980 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e760aee57215478ab8c0638faca81eae)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:38.719894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:38.722807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:38.768757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e760aee57215478ab8c0638faca81eae'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:38.769463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e760aee57215478ab8c0638faca81eae'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:38.776778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e760aee57215478ab8c0638faca81eae'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:38.789473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e760aee57215478ab8c0638faca81eae'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:38.796313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e760aee57215478ab8c0638faca81eae'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:38.802198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1155/2327] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:29:38 2022] DELETE /identity/v3/users/e760aee57215478ab8c0638faca81eae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:38.806917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8609b-44d9-4807-b7b8-93ca47f2ce01 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:38.807400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8609b-44d9-4807-b7b8-93ca47f2ce01 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:38.807500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8609b-44d9-4807-b7b8-93ca47f2ce01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:38.826280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f7a8609b-44d9-4807-b7b8-93ca47f2ce01 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:38.827481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f7a8609b-44d9-4807-b7b8-93ca47f2ce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:38.885077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1173/2328] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:38.896648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:38.898155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:38.955848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf05d4-f624-409e-a405-a47ea0344f73 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:38.959957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b97ae5-5c39-4523-872f-71c4237e0bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:38.960565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b97ae5-5c39-4523-872f-71c4237e0bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:38.960856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b97ae5-5c39-4523-872f-71c4237e0bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:38.961132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b97ae5-5c39-4523-872f-71c4237e0bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:38.970820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b97ae5-5c39-4523-872f-71c4237e0bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:38.972306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b97ae5-5c39-4523-872f-71c4237e0bf1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:38.981713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1156/2329] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:39.265484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8609b-44d9-4807-b7b8-93ca47f2ce01 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:39.268014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f7a8609b-44d9-4807-b7b8-93ca47f2ce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:39.282138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8609b-44d9-4807-b7b8-93ca47f2ce01 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:39.286965 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:39.287605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.287885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.288156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] PATH_INFO: `/v3/projects/af15846f6d684d0ab10073acd25e8c6a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.290056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af15846f6d684d0ab10073acd25e8c6a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:39.292139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:39.346519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af15846f6d684d0ab10073acd25e8c6a', 'request_id': 'req-a722f100-2c33-46b8-a4a5-a3798eca9992'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:39.352886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af15846f6d684d0ab10073acd25e8c6a', 'request_id': 'req-a722f100-2c33-46b8-a4a5-a3798eca9992'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:39.354344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:39.360699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af15846f6d684d0ab10073acd25e8c6a', 'request_id': 'req-a722f100-2c33-46b8-a4a5-a3798eca9992'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:39.374211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] The token cache is being invalidate because project af15846f6d684d0ab10073acd25e8c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:29:39.374499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:39.375135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a722f100-2c33-46b8-a4a5-a3798eca9992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:39.377171 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1174/2330] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:29:39 2022] DELETE /identity/v3/projects/af15846f6d684d0ab10073acd25e8c6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:39.382235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d60c54-6289-4e7b-a549-778e72f1b3af None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.382527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d60c54-6289-4e7b-a549-778e72f1b3af None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.382806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d60c54-6289-4e7b-a549-778e72f1b3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.403808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-31d60c54-6289-4e7b-a549-778e72f1b3af None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:39.405370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-31d60c54-6289-4e7b-a549-778e72f1b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:39.473333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1157/2331] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:39.481445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e3ca-7087-469c-af81-4742d051e0d7 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.481763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e3ca-7087-469c-af81-4742d051e0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.482065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e3ca-7087-469c-af81-4742d051e0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.505229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0bc8e3ca-7087-469c-af81-4742d051e0d7 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:39.506486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0bc8e3ca-7087-469c-af81-4742d051e0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:39.514763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1175/2332] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:39.519794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d60c54-6289-4e7b-a549-778e72f1b3af None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:39.529846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d60c54-6289-4e7b-a549-778e72f1b3af None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:39.535057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:39.535664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.535950 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.536227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.536887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:29:39.537193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:39.538832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:39.551750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1158/2333] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:29:39.555855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e3ca-7087-469c-af81-4742d051e0d7 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:39.565884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e3ca-7087-469c-af81-4742d051e0d7 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:39.570760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c637ea9-1d56-46de-8d2b-f252cc22087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:39.571362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c637ea9-1d56-46de-8d2b-f252cc22087e admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.571641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c637ea9-1d56-46de-8d2b-f252cc22087e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.571909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c637ea9-1d56-46de-8d2b-f252cc22087e admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.572547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c637ea9-1d56-46de-8d2b-f252cc22087e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:39.574516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c637ea9-1d56-46de-8d2b-f252cc22087e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:39.601319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1176/2334] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:29:39 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:39.604996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:39.615597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96ceee-caa6-40b9-8429-1b20806094f1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:39.623323 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:39.678689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b25af-d099-4933-8de8-f20f5d9408f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:39.679350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b25af-d099-4933-8de8-f20f5d9408f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.679477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b25af-d099-4933-8de8-f20f5d9408f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.679768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b25af-d099-4933-8de8-f20f5d9408f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.680386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b25af-d099-4933-8de8-f20f5d9408f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:39.682342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b25af-d099-4933-8de8-f20f5d9408f7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:39.703498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1159/2335] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:29:39 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:39.707739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c637ea9-1d56-46de-8d2b-f252cc22087e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:39.717948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c637ea9-1d56-46de-8d2b-f252cc22087e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:39.722673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ecb97-6f57-49b8-9c04-465a235d5173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:39.723263 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ecb97-6f57-49b8-9c04-465a235d5173 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.723540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ecb97-6f57-49b8-9c04-465a235d5173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.723810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ecb97-6f57-49b8-9c04-465a235d5173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.724452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ecb97-6f57-49b8-9c04-465a235d5173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:39.726112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ecb97-6f57-49b8-9c04-465a235d5173 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:39.736791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1177/2336] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:39.740677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b25af-d099-4933-8de8-f20f5d9408f7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:39.753291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b25af-d099-4933-8de8-f20f5d9408f7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:39.758731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ea772-b1d1-4e80-bab8-a500a8adc76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:39.759377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea772-b1d1-4e80-bab8-a500a8adc76f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.759666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea772-b1d1-4e80-bab8-a500a8adc76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.759943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea772-b1d1-4e80-bab8-a500a8adc76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.760603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea772-b1d1-4e80-bab8-a500a8adc76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:39.762326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea772-b1d1-4e80-bab8-a500a8adc76f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:39.775592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1160/2337] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:39.779656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ecb97-6f57-49b8-9c04-465a235d5173 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:39.790340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ecb97-6f57-49b8-9c04-465a235d5173 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:39.794974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb403a1-bcf1-44cf-8cff-3f8bedb204e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:39.795727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb403a1-bcf1-44cf-8cff-3f8bedb204e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.796006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb403a1-bcf1-44cf-8cff-3f8bedb204e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.796281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb403a1-bcf1-44cf-8cff-3f8bedb204e9 admin admin] PATH_INFO: `/v3/projects/aa013f5d1e274dad96e3f2d0f89e1026/users/441e2d1e4eb6452e84cf26e02b8f6707/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.812326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb403a1-bcf1-44cf-8cff-3f8bedb204e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa013f5d1e274dad96e3f2d0f89e1026, user_id=441e2d1e4eb6452e84cf26e02b8f6707, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:39.815667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb403a1-bcf1-44cf-8cff-3f8bedb204e9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:39.829518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1178/2338] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:39 2022] PUT /identity/v3/projects/aa013f5d1e274dad96e3f2d0f89e1026/users/441e2d1e4eb6452e84cf26e02b8f6707/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:39.840246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6ae4-af28-428b-8c9b-a9f75fff9dc0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:39.840547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6ae4-af28-428b-8c9b-a9f75fff9dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:39.840830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6ae4-af28-428b-8c9b-a9f75fff9dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:39.870008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b2de6ae4-af28-428b-8c9b-a9f75fff9dc0 None None] MFA Rules not processed for user `441e2d1e4eb6452e84cf26e02b8f6707`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:39.871233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b2de6ae4-af28-428b-8c9b-a9f75fff9dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:39.942107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1161/2339] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:39.946675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb403a1-bcf1-44cf-8cff-3f8bedb204e9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:40.011258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb403a1-bcf1-44cf-8cff-3f8bedb204e9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:40.016475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94972fc-8214-4258-9e73-92d079c9d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:40.017169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94972fc-8214-4258-9e73-92d079c9d26c admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:40.017503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94972fc-8214-4258-9e73-92d079c9d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:40.017807 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94972fc-8214-4258-9e73-92d079c9d26c admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:40.018447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94972fc-8214-4258-9e73-92d079c9d26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:40.020344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94972fc-8214-4258-9e73-92d079c9d26c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:40.047950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1179/2340] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:29:39 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:40.053256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6ae4-af28-428b-8c9b-a9f75fff9dc0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:40.066126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6ae4-af28-428b-8c9b-a9f75fff9dc0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:40.121981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4d84-3669-4a3b-bc67-ecb385f7f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:40.122598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4d84-3669-4a3b-bc67-ecb385f7f72f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:40.122888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4d84-3669-4a3b-bc67-ecb385f7f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:40.123169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4d84-3669-4a3b-bc67-ecb385f7f72f admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:40.123807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f4d84-3669-4a3b-bc67-ecb385f7f72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:40.125749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f4d84-3669-4a3b-bc67-ecb385f7f72f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:40.147239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1162/2341] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:29:40 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:40.151451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94972fc-8214-4258-9e73-92d079c9d26c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:40.162673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94972fc-8214-4258-9e73-92d079c9d26c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:40.167311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2f409-978e-4f1b-a29c-94d5043d61fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:40.167906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2f409-978e-4f1b-a29c-94d5043d61fb admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:40.168184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2f409-978e-4f1b-a29c-94d5043d61fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:40.168452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2f409-978e-4f1b-a29c-94d5043d61fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:40.169091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2f409-978e-4f1b-a29c-94d5043d61fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:40.170742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2f409-978e-4f1b-a29c-94d5043d61fb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:40.182452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1180/2342] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:40.186767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4d84-3669-4a3b-bc67-ecb385f7f72f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:40.196651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4d84-3669-4a3b-bc67-ecb385f7f72f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:40.201155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cfe28-742d-4706-91b3-d04b333ab1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:40.201821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cfe28-742d-4706-91b3-d04b333ab1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:40.202106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cfe28-742d-4706-91b3-d04b333ab1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:40.202385 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cfe28-742d-4706-91b3-d04b333ab1c2 admin admin] PATH_INFO: `/v3/projects/10ae5b5b0ffe498f8135df84fa6475a6/users/247706b603834e3f92b14b6c0319dc97/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:40.205425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:40.217696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cfe28-742d-4706-91b3-d04b333ab1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ae5b5b0ffe498f8135df84fa6475a6, user_id=247706b603834e3f92b14b6c0319dc97, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:40.220959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cfe28-742d-4706-91b3-d04b333ab1c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:40.233508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1163/2343] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:40 2022] PUT /identity/v3/projects/10ae5b5b0ffe498f8135df84fa6475a6/users/247706b603834e3f92b14b6c0319dc97/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:40.238302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2f409-978e-4f1b-a29c-94d5043d61fb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:40.248081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2f409-978e-4f1b-a29c-94d5043d61fb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:40.297448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:40.308034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636f521-85f1-4687-97ea-f3958b733ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:40.308748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636f521-85f1-4687-97ea-f3958b733ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:40.309257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636f521-85f1-4687-97ea-f3958b733ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:40.309571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636f521-85f1-4687-97ea-f3958b733ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:40.310204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636f521-85f1-4687-97ea-f3958b733ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:40.311817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636f521-85f1-4687-97ea-f3958b733ba6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:40.322275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1181/2344] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:40.327408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cfe28-742d-4706-91b3-d04b333ab1c2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:40.339144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cfe28-742d-4706-91b3-d04b333ab1c2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:40.344109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:40.344770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:40.345934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:40.346273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] PATH_INFO: `/v3/projects/10ae5b5b0ffe498f8135df84fa6475a6/users/247706b603834e3f92b14b6c0319dc97/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:40.348046 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ae5b5b0ffe498f8135df84fa6475a6, user_id=247706b603834e3f92b14b6c0319dc97, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:40.350724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:40.361556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1164/2345] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:40 2022] PUT /identity/v3/projects/10ae5b5b0ffe498f8135df84fa6475a6/users/247706b603834e3f92b14b6c0319dc97/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:40.373264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1ca5-8151-4c38-9673-71ad47f2c37c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:40.373714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1ca5-8151-4c38-9673-71ad47f2c37c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:40.374108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1ca5-8151-4c38-9673-71ad47f2c37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:40.402192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-707b1ca5-8151-4c38-9673-71ad47f2c37c None None] MFA Rules not processed for user `247706b603834e3f92b14b6c0319dc97`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:40.403421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-707b1ca5-8151-4c38-9673-71ad47f2c37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:40.470801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1182/2346] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:40.481760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:40.483488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:40.542557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6a6cf-806e-473a-8f22-72223bb45a6f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:40.546217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab826576-1616-4f43-be07-0aaa1077abc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:40.546825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab826576-1616-4f43-be07-0aaa1077abc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:40.547112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab826576-1616-4f43-be07-0aaa1077abc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:40.547390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab826576-1616-4f43-be07-0aaa1077abc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:40.556541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab826576-1616-4f43-be07-0aaa1077abc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:40.558074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab826576-1616-4f43-be07-0aaa1077abc8 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:40.567659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1165/2347] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:40.992768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1ca5-8151-4c38-9673-71ad47f2c37c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:41.060948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1ca5-8151-4c38-9673-71ad47f2c37c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:41.066688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:41.067328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:41.067662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:41.067889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] PATH_INFO: `/v3/users/441e2d1e4eb6452e84cf26e02b8f6707` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:41.069061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441e2d1e4eb6452e84cf26e02b8f6707)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:41.071035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:41.125646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441e2d1e4eb6452e84cf26e02b8f6707'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.127182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441e2d1e4eb6452e84cf26e02b8f6707'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.127824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441e2d1e4eb6452e84cf26e02b8f6707'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.142231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441e2d1e4eb6452e84cf26e02b8f6707'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.150892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441e2d1e4eb6452e84cf26e02b8f6707'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.157106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:41.169454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1183/2348] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:29:40 2022] DELETE /identity/v3/users/441e2d1e4eb6452e84cf26e02b8f6707 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:41.175351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1bba7-a2da-4691-b49c-e00e34f9f9e4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:41.176135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1bba7-a2da-4691-b49c-e00e34f9f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:41.176135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1bba7-a2da-4691-b49c-e00e34f9f9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:41.198476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-82f1bba7-a2da-4691-b49c-e00e34f9f9e4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:41.203025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-82f1bba7-a2da-4691-b49c-e00e34f9f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:41.262408 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1166/2349] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:29:41.272283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:41.273769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:41.331009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab73d-dabd-4c7c-b636-2e2b57979a80 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:41.334622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fb873-6ff4-4f51-bab7-6ee419fff5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:41.335220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fb873-6ff4-4f51-bab7-6ee419fff5bc service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:41.335493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fb873-6ff4-4f51-bab7-6ee419fff5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:41.335760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fb873-6ff4-4f51-bab7-6ee419fff5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:41.344548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fb873-6ff4-4f51-bab7-6ee419fff5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:41.346038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fb873-6ff4-4f51-bab7-6ee419fff5bc service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:41.355291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1184/2350] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:41.625446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1bba7-a2da-4691-b49c-e00e34f9f9e4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:41.626972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-82f1bba7-a2da-4691-b49c-e00e34f9f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:41.639952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1bba7-a2da-4691-b49c-e00e34f9f9e4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:41.645066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:41.645878 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:41.646176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:41.646557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] PATH_INFO: `/v3/projects/aa013f5d1e274dad96e3f2d0f89e1026` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:41.651301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa013f5d1e274dad96e3f2d0f89e1026)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:41.653305 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:41.699829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa013f5d1e274dad96e3f2d0f89e1026', 'request_id': 'req-89309871-58a5-4497-b197-e4bd6e25cc15'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.707251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa013f5d1e274dad96e3f2d0f89e1026', 'request_id': 'req-89309871-58a5-4497-b197-e4bd6e25cc15'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.712955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa013f5d1e274dad96e3f2d0f89e1026', 'request_id': 'req-89309871-58a5-4497-b197-e4bd6e25cc15'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.720271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:41.725595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] The token cache is being invalidate because project aa013f5d1e274dad96e3f2d0f89e1026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:29:41.726068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.726809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.728524 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1167/2351] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:29:41 2022] DELETE /identity/v3/projects/aa013f5d1e274dad96e3f2d0f89e1026 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:41.732433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fb873-6ff4-4f51-bab7-6ee419fff5bc service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:41.742749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fb873-6ff4-4f51-bab7-6ee419fff5bc service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:41.799026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:41.799571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:41.799850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:41.800118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] PATH_INFO: `/v3/users/247706b603834e3f92b14b6c0319dc97` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:41.801259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=247706b603834e3f92b14b6c0319dc97)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:41.803201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:41.849646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247706b603834e3f92b14b6c0319dc97'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.850288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247706b603834e3f92b14b6c0319dc97'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.850888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247706b603834e3f92b14b6c0319dc97'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.863734 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247706b603834e3f92b14b6c0319dc97'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.870657 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1ca00d90-009a-493f-89ce-4bcd83fcf6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247706b603834e3f92b14b6c0319dc97'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:41.882711 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1185/2352] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:29:41 2022] DELETE /identity/v3/users/247706b603834e3f92b14b6c0319dc97 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:29:42.171246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:42.172787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:42.187127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89309871-58a5-4497-b197-e4bd6e25cc15 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:42.246631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:42.247284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.247578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.247855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] PATH_INFO: `/v3/projects/10ae5b5b0ffe498f8135df84fa6475a6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.249025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ae5b5b0ffe498f8135df84fa6475a6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:42.251563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:42.309108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ae5b5b0ffe498f8135df84fa6475a6', 'request_id': 'req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:42.317935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ae5b5b0ffe498f8135df84fa6475a6', 'request_id': 'req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:42.324345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ae5b5b0ffe498f8135df84fa6475a6', 'request_id': 'req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:42.336827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] The token cache is being invalidate because project 10ae5b5b0ffe498f8135df84fa6475a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:29:42.337098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:42.337728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3fddfb88-5544-4e15-ae86-8406e5b8d1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:42.339247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1168/2353] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:29:42 2022] DELETE /identity/v3/projects/10ae5b5b0ffe498f8135df84fa6475a6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:42.345223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c494ad3-ab1e-46ee-b7bc-b789a8e31e06 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.345943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c494ad3-ab1e-46ee-b7bc-b789a8e31e06 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.346153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c494ad3-ab1e-46ee-b7bc-b789a8e31e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.366554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7c494ad3-ab1e-46ee-b7bc-b789a8e31e06 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:42.367766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7c494ad3-ab1e-46ee-b7bc-b789a8e31e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:42.378720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:42.432583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1186/2354] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:42.441942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58bb6-cdcd-4f9f-912f-6db9120ee664 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.442234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58bb6-cdcd-4f9f-912f-6db9120ee664 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.442512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58bb6-cdcd-4f9f-912f-6db9120ee664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.463467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dac58bb6-cdcd-4f9f-912f-6db9120ee664 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:42.464697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dac58bb6-cdcd-4f9f-912f-6db9120ee664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:42.473666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1169/2355] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:42.477896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c494ad3-ab1e-46ee-b7bc-b789a8e31e06 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:42.488444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c494ad3-ab1e-46ee-b7bc-b789a8e31e06 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:42.493036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:42.493672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.493952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.494226 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.494870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:29:42.495173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:42.496811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:42.508684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1187/2356] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:29:42.513334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58bb6-cdcd-4f9f-912f-6db9120ee664 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:42.523792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58bb6-cdcd-4f9f-912f-6db9120ee664 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:42.528675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e6df-d158-4ebd-9aab-761d82162fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:42.529361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e6df-d158-4ebd-9aab-761d82162fff admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.529971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e6df-d158-4ebd-9aab-761d82162fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.529971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e6df-d158-4ebd-9aab-761d82162fff admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.530684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e6df-d158-4ebd-9aab-761d82162fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:42.533781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e6df-d158-4ebd-9aab-761d82162fff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:42.561974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1170/2357] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:29:42 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:42.566599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:42.577169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086731c-22e3-429d-b08f-f70f415dd959 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:42.646954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e84f6-71d5-4656-9d42-05263ce7938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:42.647617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e84f6-71d5-4656-9d42-05263ce7938a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.647896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e84f6-71d5-4656-9d42-05263ce7938a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.648203 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e84f6-71d5-4656-9d42-05263ce7938a admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.648839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e84f6-71d5-4656-9d42-05263ce7938a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:42.651251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e84f6-71d5-4656-9d42-05263ce7938a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:42.675885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1188/2358] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:29:42 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:29:42.679865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e6df-d158-4ebd-9aab-761d82162fff admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:42.690869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e6df-d158-4ebd-9aab-761d82162fff admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:42.695656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe5b6-0222-4e8f-85f8-d2020a6281e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:42.696276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe5b6-0222-4e8f-85f8-d2020a6281e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.696563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe5b6-0222-4e8f-85f8-d2020a6281e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.696843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe5b6-0222-4e8f-85f8-d2020a6281e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.697503 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fe5b6-0222-4e8f-85f8-d2020a6281e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:42.699148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fe5b6-0222-4e8f-85f8-d2020a6281e3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:42.710597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1171/2359] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:42.714888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e84f6-71d5-4656-9d42-05263ce7938a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:42.725937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e84f6-71d5-4656-9d42-05263ce7938a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:42.730705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e6f8c-f897-4a33-be0d-3e0c21277e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:42.731308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6f8c-f897-4a33-be0d-3e0c21277e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.731585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6f8c-f897-4a33-be0d-3e0c21277e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.731859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6f8c-f897-4a33-be0d-3e0c21277e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.732503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e6f8c-f897-4a33-be0d-3e0c21277e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:42.734153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e6f8c-f897-4a33-be0d-3e0c21277e83 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:42.745516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1189/2360] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:42.749987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe5b6-0222-4e8f-85f8-d2020a6281e3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:42.760723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe5b6-0222-4e8f-85f8-d2020a6281e3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:42.767429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf1ec7-27b8-445a-a4f6-f0c6c3a62b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:42.768318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1ec7-27b8-445a-a4f6-f0c6c3a62b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.768602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1ec7-27b8-445a-a4f6-f0c6c3a62b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.768879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1ec7-27b8-445a-a4f6-f0c6c3a62b74 admin admin] PATH_INFO: `/v3/projects/05ef8e1010a84645bf81297091530349/users/c2be296305e04b51a0494f97e9e9ab3a/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.785038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf1ec7-27b8-445a-a4f6-f0c6c3a62b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ef8e1010a84645bf81297091530349, user_id=c2be296305e04b51a0494f97e9e9ab3a, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:42.787735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf1ec7-27b8-445a-a4f6-f0c6c3a62b74 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:42.801566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1172/2361] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:42 2022] PUT /identity/v3/projects/05ef8e1010a84645bf81297091530349/users/c2be296305e04b51a0494f97e9e9ab3a/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:42.813417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06875d13-4601-44f7-9b2b-115e536e4170 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:42.813899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06875d13-4601-44f7-9b2b-115e536e4170 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:42.814082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06875d13-4601-44f7-9b2b-115e536e4170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:42.846102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-06875d13-4601-44f7-9b2b-115e536e4170 None None] MFA Rules not processed for user `c2be296305e04b51a0494f97e9e9ab3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:42.847343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-06875d13-4601-44f7-9b2b-115e536e4170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:42.921468 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1190/2362] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:42.926075 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf1ec7-27b8-445a-a4f6-f0c6c3a62b74 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:42.956592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:42.997076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf1ec7-27b8-445a-a4f6-f0c6c3a62b74 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:43.002729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d9d98-9e57-4fc3-8fbf-d3baf4d95770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:43.003333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d9d98-9e57-4fc3-8fbf-d3baf4d95770 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:43.003621 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d9d98-9e57-4fc3-8fbf-d3baf4d95770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:43.003895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d9d98-9e57-4fc3-8fbf-d3baf4d95770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:43.004537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d9d98-9e57-4fc3-8fbf-d3baf4d95770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:43.006562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d9d98-9e57-4fc3-8fbf-d3baf4d95770 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:43.035407 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1173/2363] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:29:42 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:43.039777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06875d13-4601-44f7-9b2b-115e536e4170 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:43.051141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06875d13-4601-44f7-9b2b-115e536e4170 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:43.059882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:43.111556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0515ac-bf28-4a8a-9624-e963fd54e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:43.112168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0515ac-bf28-4a8a-9624-e963fd54e8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:43.112449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0515ac-bf28-4a8a-9624-e963fd54e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:43.112723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0515ac-bf28-4a8a-9624-e963fd54e8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:43.113376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0515ac-bf28-4a8a-9624-e963fd54e8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:43.115356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0515ac-bf28-4a8a-9624-e963fd54e8b3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:43.138939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1191/2364] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:29:43 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:43.144048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d9d98-9e57-4fc3-8fbf-d3baf4d95770 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:43.154844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d9d98-9e57-4fc3-8fbf-d3baf4d95770 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:43.160903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192862d-c908-4745-8f30-0f31e05afd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:43.161525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192862d-c908-4745-8f30-0f31e05afd98 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:43.161837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192862d-c908-4745-8f30-0f31e05afd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:43.162110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192862d-c908-4745-8f30-0f31e05afd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:43.162777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192862d-c908-4745-8f30-0f31e05afd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:43.164509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192862d-c908-4745-8f30-0f31e05afd98 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:43.178345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1174/2365] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:29:43.182599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0515ac-bf28-4a8a-9624-e963fd54e8b3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:43.193002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0515ac-bf28-4a8a-9624-e963fd54e8b3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:43.197833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3647f-597b-4917-8a88-e7286bac7519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:43.198507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3647f-597b-4917-8a88-e7286bac7519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:43.198791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3647f-597b-4917-8a88-e7286bac7519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:43.199067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3647f-597b-4917-8a88-e7286bac7519 admin admin] PATH_INFO: `/v3/projects/987d2664441a4f77b1db348ff0928e8c/users/6e191e86544f4aaf8949333f09f7d13e/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:43.224099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3647f-597b-4917-8a88-e7286bac7519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987d2664441a4f77b1db348ff0928e8c, user_id=6e191e86544f4aaf8949333f09f7d13e, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:43.226966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3647f-597b-4917-8a88-e7286bac7519 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:43.241805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1192/2366] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:43 2022] PUT /identity/v3/projects/987d2664441a4f77b1db348ff0928e8c/users/6e191e86544f4aaf8949333f09f7d13e/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:29:43.246623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192862d-c908-4745-8f30-0f31e05afd98 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:43.260518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192862d-c908-4745-8f30-0f31e05afd98 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:43.328817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4af07f-3c60-46c3-aeec-2c08a1194ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:43.329988 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af07f-3c60-46c3-aeec-2c08a1194ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:43.330280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af07f-3c60-46c3-aeec-2c08a1194ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:43.330646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af07f-3c60-46c3-aeec-2c08a1194ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:43.331304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4af07f-3c60-46c3-aeec-2c08a1194ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:43.332902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4af07f-3c60-46c3-aeec-2c08a1194ff3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:43.343705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1175/2367] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:43.349194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3647f-597b-4917-8a88-e7286bac7519 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:43.359720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3647f-597b-4917-8a88-e7286bac7519 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:43.365978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:43.366702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:43.367020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:43.367329 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] PATH_INFO: `/v3/projects/987d2664441a4f77b1db348ff0928e8c/users/6e191e86544f4aaf8949333f09f7d13e/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:43.369352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987d2664441a4f77b1db348ff0928e8c, user_id=6e191e86544f4aaf8949333f09f7d13e, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:43.372066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:43.383182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1193/2368] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:43 2022] PUT /identity/v3/projects/987d2664441a4f77b1db348ff0928e8c/users/6e191e86544f4aaf8949333f09f7d13e/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:43.394427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f553b-e75e-4469-a5ac-f4e2f0971d1d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:43.394719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f553b-e75e-4469-a5ac-f4e2f0971d1d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:43.395002 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f553b-e75e-4469-a5ac-f4e2f0971d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:43.423404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-348f553b-e75e-4469-a5ac-f4e2f0971d1d None None] MFA Rules not processed for user `6e191e86544f4aaf8949333f09f7d13e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:43.424626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-348f553b-e75e-4469-a5ac-f4e2f0971d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:43.491071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1176/2369] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:29:43.501902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:43.503659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:43.561186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009504e-4bcf-4c81-9b26-fb0ddc0cd829 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:43.564887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4eca6-9886-4f46-8e13-b296aeb36d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:43.566015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eca6-9886-4f46-8e13-b296aeb36d99 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:43.566295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eca6-9886-4f46-8e13-b296aeb36d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:43.566583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eca6-9886-4f46-8e13-b296aeb36d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:43.576006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4eca6-9886-4f46-8e13-b296aeb36d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:43.577433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4eca6-9886-4f46-8e13-b296aeb36d99 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:43.587791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1194/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:44.150498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f553b-e75e-4469-a5ac-f4e2f0971d1d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:44.172449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:44.219069 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f553b-e75e-4469-a5ac-f4e2f0971d1d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:44.225798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:44.226537 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:44.226849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:44.227128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] PATH_INFO: `/v3/users/c2be296305e04b51a0494f97e9e9ab3a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:44.228278 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2be296305e04b51a0494f97e9e9ab3a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:44.230267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:44.281047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2be296305e04b51a0494f97e9e9ab3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.281723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2be296305e04b51a0494f97e9e9ab3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.290212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2be296305e04b51a0494f97e9e9ab3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.303442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2be296305e04b51a0494f97e9e9ab3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.310571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2be296305e04b51a0494f97e9e9ab3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.317193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1177/2371] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:29:44 2022] DELETE /identity/v3/users/c2be296305e04b51a0494f97e9e9ab3a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:44.321894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01768d-fe18-4bcd-a710-e5e93b035a8d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:44.322182 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01768d-fe18-4bcd-a710-e5e93b035a8d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:44.322460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01768d-fe18-4bcd-a710-e5e93b035a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:44.343307 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-9f01768d-fe18-4bcd-a710-e5e93b035a8d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:44.344545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9f01768d-fe18-4bcd-a710-e5e93b035a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:44.406102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1195/2372] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:44.416773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:44.418224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:44.477774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876ba23-4a41-488c-afda-e7549075494c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:44.481622 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdbb3a-16e8-4b50-9d42-8307b4806365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:44.482266 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdbb3a-16e8-4b50-9d42-8307b4806365 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:44.482558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdbb3a-16e8-4b50-9d42-8307b4806365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:44.482833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdbb3a-16e8-4b50-9d42-8307b4806365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:44.492948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdbb3a-16e8-4b50-9d42-8307b4806365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:44.494483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdbb3a-16e8-4b50-9d42-8307b4806365 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:44.503978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1178/2373] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:44.810391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01768d-fe18-4bcd-a710-e5e93b035a8d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:44.812056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9f01768d-fe18-4bcd-a710-e5e93b035a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:44.825865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01768d-fe18-4bcd-a710-e5e93b035a8d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:44.832469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:44.833119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:44.833409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:44.833723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] PATH_INFO: `/v3/projects/05ef8e1010a84645bf81297091530349` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:44.835077 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ef8e1010a84645bf81297091530349)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:44.837574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:44.840579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:44.891103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ef8e1010a84645bf81297091530349', 'request_id': 'req-b84969cb-bf4f-4ee7-86a1-c90454a40a16'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.899453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ef8e1010a84645bf81297091530349', 'request_id': 'req-b84969cb-bf4f-4ee7-86a1-c90454a40a16'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.906064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ef8e1010a84645bf81297091530349', 'request_id': 'req-b84969cb-bf4f-4ee7-86a1-c90454a40a16'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.921147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] The token cache is being invalidate because project 05ef8e1010a84645bf81297091530349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:29:44.921499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.922255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:44.926872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1196/2374] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:29:44 2022] DELETE /identity/v3/projects/05ef8e1010a84645bf81297091530349 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:44.928212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdbb3a-16e8-4b50-9d42-8307b4806365 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:44.937677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdbb3a-16e8-4b50-9d42-8307b4806365 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:44.991301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:45.016180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:45.017778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.018296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.018760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] PATH_INFO: `/v3/users/6e191e86544f4aaf8949333f09f7d13e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.020593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e191e86544f4aaf8949333f09f7d13e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:45.024148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:45.071633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e191e86544f4aaf8949333f09f7d13e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.072273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e191e86544f4aaf8949333f09f7d13e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.080265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e191e86544f4aaf8949333f09f7d13e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.092500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e191e86544f4aaf8949333f09f7d13e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.101126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fa6cb78c-58ad-416b-b00a-8bb2cd17bb87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e191e86544f4aaf8949333f09f7d13e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.108021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1179/2375] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:29:44 2022] DELETE /identity/v3/users/6e191e86544f4aaf8949333f09f7d13e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:45.397449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:45.399668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:45.414343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84969cb-bf4f-4ee7-86a1-c90454a40a16 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:45.472036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:45.472676 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.472959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.473235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] PATH_INFO: `/v3/projects/987d2664441a4f77b1db348ff0928e8c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.474436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=987d2664441a4f77b1db348ff0928e8c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:45.476303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:45.523044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987d2664441a4f77b1db348ff0928e8c', 'request_id': 'req-e4515d04-02f4-4774-965c-ac2f8cf6f34f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.529298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987d2664441a4f77b1db348ff0928e8c', 'request_id': 'req-e4515d04-02f4-4774-965c-ac2f8cf6f34f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.537178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987d2664441a4f77b1db348ff0928e8c', 'request_id': 'req-e4515d04-02f4-4774-965c-ac2f8cf6f34f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.550446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] The token cache is being invalidate because project 987d2664441a4f77b1db348ff0928e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:29:45.550736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.551380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e4515d04-02f4-4774-965c-ac2f8cf6f34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:45.552898 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1197/2376] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:29:45 2022] DELETE /identity/v3/projects/987d2664441a4f77b1db348ff0928e8c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:29:45.557915 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defd530-1a4f-4b40-ad25-1727957a286c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.558393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defd530-1a4f-4b40-ad25-1727957a286c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.558491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defd530-1a4f-4b40-ad25-1727957a286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.579668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1defd530-1a4f-4b40-ad25-1727957a286c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:45.580876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1defd530-1a4f-4b40-ad25-1727957a286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:45.640743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1180/2377] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:45.650050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18725741-7eab-4a26-85d9-6aeaeffd3624 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.650657 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18725741-7eab-4a26-85d9-6aeaeffd3624 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.651122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18725741-7eab-4a26-85d9-6aeaeffd3624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.675181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-18725741-7eab-4a26-85d9-6aeaeffd3624 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:45.676610 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-18725741-7eab-4a26-85d9-6aeaeffd3624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:45.684529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1198/2378] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:45.689496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defd530-1a4f-4b40-ad25-1727957a286c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:45.702942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defd530-1a4f-4b40-ad25-1727957a286c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:45.709258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:45.709932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.710216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.710489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.711208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:29:45.711518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:45.713109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:45.725829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1181/2379] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:29:45.730238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18725741-7eab-4a26-85d9-6aeaeffd3624 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:45.739517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18725741-7eab-4a26-85d9-6aeaeffd3624 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:45.744086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f9ad-88ab-4681-bbb1-6cd3e1dbe99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:45.744670 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9ad-88ab-4681-bbb1-6cd3e1dbe99e admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.744946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9ad-88ab-4681-bbb1-6cd3e1dbe99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.745214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9ad-88ab-4681-bbb1-6cd3e1dbe99e admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.745888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651f9ad-88ab-4681-bbb1-6cd3e1dbe99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:45.747801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651f9ad-88ab-4681-bbb1-6cd3e1dbe99e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:45.759091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:45.777859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1199/2380] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:29:45 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:45.783347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:45.794276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb7a84-ae7f-4e8c-bc58-08fb1f5bfdd5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:45.840928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:45.855087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015110c-cab1-487f-ac2a-33612dcf7050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:45.855706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015110c-cab1-487f-ac2a-33612dcf7050 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.855993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015110c-cab1-487f-ac2a-33612dcf7050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.856272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015110c-cab1-487f-ac2a-33612dcf7050 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.856929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015110c-cab1-487f-ac2a-33612dcf7050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:45.858905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015110c-cab1-487f-ac2a-33612dcf7050 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:45.881704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1182/2381] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:29:45 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:45.885788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f9ad-88ab-4681-bbb1-6cd3e1dbe99e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:45.897440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f9ad-88ab-4681-bbb1-6cd3e1dbe99e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:45.902025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cde99-0c1b-4a73-8f2d-28806e7ea954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:45.902659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cde99-0c1b-4a73-8f2d-28806e7ea954 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.902934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cde99-0c1b-4a73-8f2d-28806e7ea954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.903217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cde99-0c1b-4a73-8f2d-28806e7ea954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.903852 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cde99-0c1b-4a73-8f2d-28806e7ea954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:45.905440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cde99-0c1b-4a73-8f2d-28806e7ea954 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:45.917308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1200/2382] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:45.921812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015110c-cab1-487f-ac2a-33612dcf7050 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:45.932730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015110c-cab1-487f-ac2a-33612dcf7050 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:45.937406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efcae6-9208-4f7e-9682-c6a5fe4547fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:45.938044 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efcae6-9208-4f7e-9682-c6a5fe4547fe admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.938855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efcae6-9208-4f7e-9682-c6a5fe4547fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.939170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efcae6-9208-4f7e-9682-c6a5fe4547fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.939853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efcae6-9208-4f7e-9682-c6a5fe4547fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:45.941454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efcae6-9208-4f7e-9682-c6a5fe4547fe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:45.954800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1183/2383] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:45.959215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cde99-0c1b-4a73-8f2d-28806e7ea954 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:45.969426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cde99-0c1b-4a73-8f2d-28806e7ea954 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:45.974490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c78b-febf-41d9-abb0-be8be7e0911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:45.975139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c78b-febf-41d9-abb0-be8be7e0911e admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:45.975422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c78b-febf-41d9-abb0-be8be7e0911e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:45.975693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c78b-febf-41d9-abb0-be8be7e0911e admin admin] PATH_INFO: `/v3/projects/da1e1ae7bb8b4fdcb0bcd81f6194e892/users/06ff89ba381749ecb76c0ee6a59fe77d/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:45.993582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c78b-febf-41d9-abb0-be8be7e0911e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1e1ae7bb8b4fdcb0bcd81f6194e892, user_id=06ff89ba381749ecb76c0ee6a59fe77d, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:45.996253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c78b-febf-41d9-abb0-be8be7e0911e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:46.011233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1201/2384] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:45 2022] PUT /identity/v3/projects/da1e1ae7bb8b4fdcb0bcd81f6194e892/users/06ff89ba381749ecb76c0ee6a59fe77d/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:46.023806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cef51-2efb-490b-9e49-6595d498abcc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.024091 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cef51-2efb-490b-9e49-6595d498abcc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.024364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cef51-2efb-490b-9e49-6595d498abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.052138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e0cef51-2efb-490b-9e49-6595d498abcc None None] MFA Rules not processed for user `06ff89ba381749ecb76c0ee6a59fe77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:46.053360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e0cef51-2efb-490b-9e49-6595d498abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:46.116702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1184/2385] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:46.121177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c78b-febf-41d9-abb0-be8be7e0911e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:46.183250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c78b-febf-41d9-abb0-be8be7e0911e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:46.188029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f1087-ed17-4740-8ff6-4e05fa81bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:46.189310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f1087-ed17-4740-8ff6-4e05fa81bd3a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.189621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f1087-ed17-4740-8ff6-4e05fa81bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.189900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f1087-ed17-4740-8ff6-4e05fa81bd3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.190530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f1087-ed17-4740-8ff6-4e05fa81bd3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:46.192427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f1087-ed17-4740-8ff6-4e05fa81bd3a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:46.222573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1202/2386] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:29:46 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:46.223742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cef51-2efb-490b-9e49-6595d498abcc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:46.234330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cef51-2efb-490b-9e49-6595d498abcc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:46.290916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48582f-c1cd-422f-ba07-19a5e6b6c550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:46.291520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48582f-c1cd-422f-ba07-19a5e6b6c550 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.291801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48582f-c1cd-422f-ba07-19a5e6b6c550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.292073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48582f-c1cd-422f-ba07-19a5e6b6c550 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.292710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48582f-c1cd-422f-ba07-19a5e6b6c550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:46.294686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48582f-c1cd-422f-ba07-19a5e6b6c550 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:46.316453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1185/2387] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:29:46 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:29:46.320830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f1087-ed17-4740-8ff6-4e05fa81bd3a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:46.331616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f1087-ed17-4740-8ff6-4e05fa81bd3a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:46.336241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21847656-4044-4cba-99b9-660746ae5afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:46.336836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21847656-4044-4cba-99b9-660746ae5afc admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.337112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21847656-4044-4cba-99b9-660746ae5afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.337384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21847656-4044-4cba-99b9-660746ae5afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.338049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21847656-4044-4cba-99b9-660746ae5afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:46.339632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21847656-4044-4cba-99b9-660746ae5afc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:46.350216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1203/2388] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:46.354710 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48582f-c1cd-422f-ba07-19a5e6b6c550 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:46.365174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48582f-c1cd-422f-ba07-19a5e6b6c550 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:46.369758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e3abd-031f-42ee-b358-e740103ad147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:46.370405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e3abd-031f-42ee-b358-e740103ad147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.370687 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e3abd-031f-42ee-b358-e740103ad147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.370961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e3abd-031f-42ee-b358-e740103ad147 admin admin] PATH_INFO: `/v3/projects/35e046a2d0a94aa9bc6bea3bdd072a88/users/92b56c105a16434285980381a7d540a4/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.385751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e3abd-031f-42ee-b358-e740103ad147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e046a2d0a94aa9bc6bea3bdd072a88, user_id=92b56c105a16434285980381a7d540a4, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:46.388900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e3abd-031f-42ee-b358-e740103ad147 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:46.401658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1186/2389] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:46 2022] PUT /identity/v3/projects/35e046a2d0a94aa9bc6bea3bdd072a88/users/92b56c105a16434285980381a7d540a4/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:29:46.405672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21847656-4044-4cba-99b9-660746ae5afc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:46.416029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21847656-4044-4cba-99b9-660746ae5afc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:46.471355 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91974de2-c732-4dfc-b016-2bc0e75bb353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:46.472062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91974de2-c732-4dfc-b016-2bc0e75bb353 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.472372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91974de2-c732-4dfc-b016-2bc0e75bb353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.472643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91974de2-c732-4dfc-b016-2bc0e75bb353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.473280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91974de2-c732-4dfc-b016-2bc0e75bb353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:46.474900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91974de2-c732-4dfc-b016-2bc0e75bb353 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:46.484611 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1204/2390] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:46.488827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e3abd-031f-42ee-b358-e740103ad147 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:46.499154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e3abd-031f-42ee-b358-e740103ad147 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:46.503965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:46.504612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.504899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.505177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] PATH_INFO: `/v3/projects/35e046a2d0a94aa9bc6bea3bdd072a88/users/92b56c105a16434285980381a7d540a4/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.507116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e046a2d0a94aa9bc6bea3bdd072a88, user_id=92b56c105a16434285980381a7d540a4, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:46.509772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:46.520674 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1187/2391] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:46 2022] PUT /identity/v3/projects/35e046a2d0a94aa9bc6bea3bdd072a88/users/92b56c105a16434285980381a7d540a4/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:46.531347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51707d-ed6b-4e50-8f87-d9927f4508a6 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.531813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51707d-ed6b-4e50-8f87-d9927f4508a6 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.532859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51707d-ed6b-4e50-8f87-d9927f4508a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.562651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2a51707d-ed6b-4e50-8f87-d9927f4508a6 None None] MFA Rules not processed for user `92b56c105a16434285980381a7d540a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:46.563920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2a51707d-ed6b-4e50-8f87-d9927f4508a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:46.576177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:46.634186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1205/2392] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:46.645802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:46.647573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:46.658597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:46.706045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cac4d-1d66-4ec2-9d0f-a8c29a636511 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:46.709666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09058678-1a30-4e43-85a1-d5c39915f6be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:46.710267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09058678-1a30-4e43-85a1-d5c39915f6be service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:46.710548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09058678-1a30-4e43-85a1-d5c39915f6be service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:46.710822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09058678-1a30-4e43-85a1-d5c39915f6be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:46.776923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09058678-1a30-4e43-85a1-d5c39915f6be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:46.778823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09058678-1a30-4e43-85a1-d5c39915f6be service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:46.788026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1188/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:51.262873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51707d-ed6b-4e50-8f87-d9927f4508a6 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:51.264447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2a51707d-ed6b-4e50-8f87-d9927f4508a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:51.277054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51707d-ed6b-4e50-8f87-d9927f4508a6 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:51.280702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c582-e678-4576-a577-5244170cb1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:51.281366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c582-e678-4576-a577-5244170cb1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:51.281836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c582-e678-4576-a577-5244170cb1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:51.282025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c582-e678-4576-a577-5244170cb1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:51.292075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2c582-e678-4576-a577-5244170cb1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:51.293505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2c582-e678-4576-a577-5244170cb1d1 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:51.303972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1206/2394] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:56.294981 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09058678-1a30-4e43-85a1-d5c39915f6be service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:56.355754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09058678-1a30-4e43-85a1-d5c39915f6be service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:56.361289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:56.361945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:56.362235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:56.362516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] PATH_INFO: `/v3/users/06ff89ba381749ecb76c0ee6a59fe77d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:56.363635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ff89ba381749ecb76c0ee6a59fe77d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:56.365566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:56.411738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ff89ba381749ecb76c0ee6a59fe77d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.412381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ff89ba381749ecb76c0ee6a59fe77d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.419776 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ff89ba381749ecb76c0ee6a59fe77d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.428228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:56.433637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ff89ba381749ecb76c0ee6a59fe77d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.441902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ff89ba381749ecb76c0ee6a59fe77d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.447846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1189/2395] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:29:56 2022] DELETE /identity/v3/users/06ff89ba381749ecb76c0ee6a59fe77d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:56.452315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39583-30af-484f-bcdc-da2fe927c1c0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:56.453450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39583-30af-484f-bcdc-da2fe927c1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:56.453450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39583-30af-484f-bcdc-da2fe927c1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:56.473021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e6f39583-30af-484f-bcdc-da2fe927c1c0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:56.474292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e6f39583-30af-484f-bcdc-da2fe927c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:56.534401 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1207/2396] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:56.545026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:56.546520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:56.604108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b2047-4207-47e0-b306-ed1a435ff14e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:56.608114 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce497c-2a74-4def-acce-01c31c89c400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:56.608729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce497c-2a74-4def-acce-01c31c89c400 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:56.609018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce497c-2a74-4def-acce-01c31c89c400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:56.609326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce497c-2a74-4def-acce-01c31c89c400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:56.619322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce497c-2a74-4def-acce-01c31c89c400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:56.620775 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce497c-2a74-4def-acce-01c31c89c400 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:56.632787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1190/2397] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:29:56.902708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f39583-30af-484f-bcdc-da2fe927c1c0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:56.904327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e6f39583-30af-484f-bcdc-da2fe927c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:56.916790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f39583-30af-484f-bcdc-da2fe927c1c0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:56.921856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:56.922529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:56.922765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:56.923027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] PATH_INFO: `/v3/projects/da1e1ae7bb8b4fdcb0bcd81f6194e892` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:56.924230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1e1ae7bb8b4fdcb0bcd81f6194e892)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:56.926167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:56.972912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1e1ae7bb8b4fdcb0bcd81f6194e892', 'request_id': 'req-253df70a-4605-4796-a231-97b843d414b5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.979020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1e1ae7bb8b4fdcb0bcd81f6194e892', 'request_id': 'req-253df70a-4605-4796-a231-97b843d414b5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.984537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1e1ae7bb8b4fdcb0bcd81f6194e892', 'request_id': 'req-253df70a-4605-4796-a231-97b843d414b5'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.996755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] The token cache is being invalidate because project da1e1ae7bb8b4fdcb0bcd81f6194e892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:29:56.997036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.997722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:56.999188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1208/2398] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:29:56 2022] DELETE /identity/v3/projects/da1e1ae7bb8b4fdcb0bcd81f6194e892 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:57.003720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce497c-2a74-4def-acce-01c31c89c400 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:57.013829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce497c-2a74-4def-acce-01c31c89c400 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:57.072182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:57.072817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:57.073110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:57.073387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] PATH_INFO: `/v3/users/92b56c105a16434285980381a7d540a4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:57.074549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b56c105a16434285980381a7d540a4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:57.076474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:57.135935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b56c105a16434285980381a7d540a4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.136809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b56c105a16434285980381a7d540a4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.147113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b56c105a16434285980381a7d540a4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.162843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b56c105a16434285980381a7d540a4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.171232 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6298e0aa-5bf4-4720-ac29-7460b2a005d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b56c105a16434285980381a7d540a4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.181868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1191/2399] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:29:57 2022] DELETE /identity/v3/users/92b56c105a16434285980381a7d540a4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:57.499758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:57.502063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:57.516304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253df70a-4605-4796-a231-97b843d414b5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:57.544722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:57.591425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:57.592075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:57.592380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:57.592635 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] PATH_INFO: `/v3/projects/35e046a2d0a94aa9bc6bea3bdd072a88` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:57.594328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e046a2d0a94aa9bc6bea3bdd072a88)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:57.596270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:57.647114 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e046a2d0a94aa9bc6bea3bdd072a88', 'request_id': 'req-a25d684f-864f-4c52-95fc-b0498aafd5ca'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.653490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e046a2d0a94aa9bc6bea3bdd072a88', 'request_id': 'req-a25d684f-864f-4c52-95fc-b0498aafd5ca'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.659951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e046a2d0a94aa9bc6bea3bdd072a88', 'request_id': 'req-a25d684f-864f-4c52-95fc-b0498aafd5ca'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.675098 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] The token cache is being invalidate because project 35e046a2d0a94aa9bc6bea3bdd072a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:29:57.675638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.676306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a25d684f-864f-4c52-95fc-b0498aafd5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:29:57.677890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1209/2400] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:29:57 2022] DELETE /identity/v3/projects/35e046a2d0a94aa9bc6bea3bdd072a88 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:29:57.684042 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12ec8-54e8-4fe2-88d7-417c925562b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:57.684590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12ec8-54e8-4fe2-88d7-417c925562b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:57.684590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12ec8-54e8-4fe2-88d7-417c925562b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:57.694646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:57.706870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-16d12ec8-54e8-4fe2-88d7-417c925562b2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:57.709978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-16d12ec8-54e8-4fe2-88d7-417c925562b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:57.772582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1192/2401] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:29:57.782248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c1bb-662d-43ea-8272-b4ff25daf398 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:57.782555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c1bb-662d-43ea-8272-b4ff25daf398 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:57.782837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c1bb-662d-43ea-8272-b4ff25daf398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:57.805743 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-b835c1bb-662d-43ea-8272-b4ff25daf398 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:57.806984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b835c1bb-662d-43ea-8272-b4ff25daf398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:57.815784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1210/2402] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:57.820282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d12ec8-54e8-4fe2-88d7-417c925562b2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:57.830259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d12ec8-54e8-4fe2-88d7-417c925562b2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:57.834806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:57.835400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:57.835681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:57.835952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:57.836599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:29:57.836901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:57.838523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:57.851117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1193/2403] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:29:57.855765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c1bb-662d-43ea-8272-b4ff25daf398 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:57.865812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c1bb-662d-43ea-8272-b4ff25daf398 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:57.870548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c613e-4457-49fe-b6bf-cfb594a90472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:57.871142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c613e-4457-49fe-b6bf-cfb594a90472 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:57.871415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c613e-4457-49fe-b6bf-cfb594a90472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:57.871680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c613e-4457-49fe-b6bf-cfb594a90472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:57.872302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c613e-4457-49fe-b6bf-cfb594a90472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:57.874381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c613e-4457-49fe-b6bf-cfb594a90472 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:57.902256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1211/2404] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:29:57.906989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:57.917937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e2ed-21d5-4423-9ec4-722527268df9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:57.983649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610e737-d88b-4f68-b328-309f6e043086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:57.984338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610e737-d88b-4f68-b328-309f6e043086 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:57.984763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610e737-d88b-4f68-b328-309f6e043086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:57.985111 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610e737-d88b-4f68-b328-309f6e043086 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:57.985812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610e737-d88b-4f68-b328-309f6e043086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:57.987752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610e737-d88b-4f68-b328-309f6e043086 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:58.011745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1194/2405] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:29:57 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:29:58.017347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c613e-4457-49fe-b6bf-cfb594a90472 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:58.028082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c613e-4457-49fe-b6bf-cfb594a90472 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:58.033619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1445d-76b6-45bc-ad32-d51361261e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:58.034242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1445d-76b6-45bc-ad32-d51361261e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:58.034523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1445d-76b6-45bc-ad32-d51361261e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:58.034799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1445d-76b6-45bc-ad32-d51361261e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:58.035455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1445d-76b6-45bc-ad32-d51361261e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:58.037115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1445d-76b6-45bc-ad32-d51361261e7e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:58.048156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1212/2406] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:58.052614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610e737-d88b-4f68-b328-309f6e043086 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:58.063006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610e737-d88b-4f68-b328-309f6e043086 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:58.067751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395d482-472a-4eae-b3ca-7c81576ef22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:58.068353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d482-472a-4eae-b3ca-7c81576ef22c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:58.068665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d482-472a-4eae-b3ca-7c81576ef22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:58.068939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d482-472a-4eae-b3ca-7c81576ef22c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:58.069754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395d482-472a-4eae-b3ca-7c81576ef22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:58.071208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395d482-472a-4eae-b3ca-7c81576ef22c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:58.083647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1195/2407] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:29:58.088790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1445d-76b6-45bc-ad32-d51361261e7e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:58.105947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1445d-76b6-45bc-ad32-d51361261e7e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:58.110832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:58.111527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:58.111801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:58.112070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] PATH_INFO: `/v3/projects/a1b8b36c1bbe4645b0da38948cbd66ac/users/8501f668e45d4e4a8ac24b56ac564e7f/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:58.134917 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b8b36c1bbe4645b0da38948cbd66ac, user_id=8501f668e45d4e4a8ac24b56ac564e7f, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:58.137972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:58.153637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1213/2408] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:29:58 2022] PUT /identity/v3/projects/a1b8b36c1bbe4645b0da38948cbd66ac/users/8501f668e45d4e4a8ac24b56ac564e7f/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:29:58.166825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c033cf-623e-47f4-b7e0-9aef0ef6e3f0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:58.167121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c033cf-623e-47f4-b7e0-9aef0ef6e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:58.167428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c033cf-623e-47f4-b7e0-9aef0ef6e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:58.205368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b8c033cf-623e-47f4-b7e0-9aef0ef6e3f0 None None] MFA Rules not processed for user `8501f668e45d4e4a8ac24b56ac564e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:29:58.206653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b8c033cf-623e-47f4-b7e0-9aef0ef6e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:58.279509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:58.286786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1196/2409] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:29:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:29:58.302658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:29:58.304931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:29:58.370483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:29:58.375823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a38bc-5a65-4834-b30d-af1c11700905 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:29:58.383045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa525-501e-448f-8dd7-286a62274278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:29:58.383045 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa525-501e-448f-8dd7-286a62274278 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:29:58.387574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa525-501e-448f-8dd7-286a62274278 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:29:58.388937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa525-501e-448f-8dd7-286a62274278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:29:58.400794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afa525-501e-448f-8dd7-286a62274278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:29:58.402473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afa525-501e-448f-8dd7-286a62274278 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:29:58.415055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1214/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:30:02.781945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af3d43-a415-458e-854b-9ade6dc8262f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:02.782757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af3d43-a415-458e-854b-9ade6dc8262f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:02.782949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af3d43-a415-458e-854b-9ade6dc8262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:02.803714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-94af3d43-a415-458e-854b-9ade6dc8262f None None] MFA Rules not processed for user `57d8dd7c820144a082032626cb481df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:02.804957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-94af3d43-a415-458e-854b-9ade6dc8262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:02.858332 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1197/2411] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:08.409708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:12.401067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa525-501e-448f-8dd7-286a62274278 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:12.465375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa525-501e-448f-8dd7-286a62274278 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:12.470959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:12.471590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:12.471869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:12.472133 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] PATH_INFO: `/v3/users/8501f668e45d4e4a8ac24b56ac564e7f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:12.473235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8501f668e45d4e4a8ac24b56ac564e7f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:12.475364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:12.522842 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8501f668e45d4e4a8ac24b56ac564e7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:12.523423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8501f668e45d4e4a8ac24b56ac564e7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:12.524017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8501f668e45d4e4a8ac24b56ac564e7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:12.538067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8501f668e45d4e4a8ac24b56ac564e7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:12.548040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8501f668e45d4e4a8ac24b56ac564e7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:12.562184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1215/2412] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:30:12 2022] DELETE /identity/v3/users/8501f668e45d4e4a8ac24b56ac564e7f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:30:12.566800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78882d8-5d55-49cd-8d08-c7987c4dee33 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:12.567335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78882d8-5d55-49cd-8d08-c7987c4dee33 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:12.567335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78882d8-5d55-49cd-8d08-c7987c4dee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:12.587488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f78882d8-5d55-49cd-8d08-c7987c4dee33 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:12.588706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f78882d8-5d55-49cd-8d08-c7987c4dee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:12.667235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1198/2413] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:12.677649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:12.679099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:12.755751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaef0a3-7365-425a-8715-b5ada5370840 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:12.759495 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:12.760120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:12.760404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:12.760704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:12.771324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:12.772762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:12.784304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1216/2414] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:30:12.966817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa37d-66fb-44ea-88c7-d292f89c88ff None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:12.967180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa37d-66fb-44ea-88c7-d292f89c88ff None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:12.967418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa37d-66fb-44ea-88c7-d292f89c88ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.005873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5a4fa37d-66fb-44ea-88c7-d292f89c88ff None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:13.007153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a4fa37d-66fb-44ea-88c7-d292f89c88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:13.081425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1199/2415] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:13.137144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:13.141421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:13.155723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fa37d-66fb-44ea-88c7-d292f89c88ff None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:13.159185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a4fa37d-66fb-44ea-88c7-d292f89c88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:13.195523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:13.203570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fa37d-66fb-44ea-88c7-d292f89c88ff None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:13.220093 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:13.221077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.221500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.221968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] PATH_INFO: `/v3/projects/a1b8b36c1bbe4645b0da38948cbd66ac` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.225462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b8b36c1bbe4645b0da38948cbd66ac)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:13.235597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:13.311887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:13.317576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b8b36c1bbe4645b0da38948cbd66ac', 'request_id': 'req-9170fbcd-f6b6-4414-963e-a493fdd4a108'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:13.319019 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ce541-11dc-4a02-bef4-88154a020286 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:13.336581 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b8b36c1bbe4645b0da38948cbd66ac', 'request_id': 'req-9170fbcd-f6b6-4414-963e-a493fdd4a108'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:13.346968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b8b36c1bbe4645b0da38948cbd66ac', 'request_id': 'req-9170fbcd-f6b6-4414-963e-a493fdd4a108'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:13.360449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] The token cache is being invalidate because project a1b8b36c1bbe4645b0da38948cbd66ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:30:13.360758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:13.361404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9170fbcd-f6b6-4414-963e-a493fdd4a108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:13.364008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1200/2416] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:30:13 2022] DELETE /identity/v3/projects/a1b8b36c1bbe4645b0da38948cbd66ac => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:30:13.371502 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ee5ac-5126-4a18-a3b4-13e632b037a5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.372006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ee5ac-5126-4a18-a3b4-13e632b037a5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.372746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ee5ac-5126-4a18-a3b4-13e632b037a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.401291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:13.401935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.402215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.402491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.404335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:13.407241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b21ee5ac-5126-4a18-a3b4-13e632b037a5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:13.409165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b21ee5ac-5126-4a18-a3b4-13e632b037a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:13.479951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:13.481745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:13.494376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1201/2417] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:13.496017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1217/2418] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:30:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:13.497789 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cb2ea-18e4-4664-85e5-b916759f27a5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.498115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cb2ea-18e4-4664-85e5-b916759f27a5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.498210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cb2ea-18e4-4664-85e5-b916759f27a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.523389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-039cb2ea-18e4-4664-85e5-b916759f27a5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:13.525389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-039cb2ea-18e4-4664-85e5-b916759f27a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:13.540609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1202/2419] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:13.552231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:13.565014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca57af-c731-400a-8e36-9f4bd1bfb101 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:13.576308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:13.578078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.578314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.578583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.579245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:30:13.579547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:13.581217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:13.604954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1218/2420] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:30:13.610491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cb2ea-18e4-4664-85e5-b916759f27a5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:13.621312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cb2ea-18e4-4664-85e5-b916759f27a5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:13.627277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5332f-b3a9-41f0-8b07-a1e417b4ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:13.627909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5332f-b3a9-41f0-8b07-a1e417b4ac0f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.628212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5332f-b3a9-41f0-8b07-a1e417b4ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.628909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5332f-b3a9-41f0-8b07-a1e417b4ac0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.629143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5332f-b3a9-41f0-8b07-a1e417b4ac0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:13.631165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5332f-b3a9-41f0-8b07-a1e417b4ac0f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:13.672366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1203/2421] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:30:13 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:30:13.674561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:13.686787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed619e97-c51c-4bf3-a282-039d6fb0ae8a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:13.778795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:13.790172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53647bb-96f1-498d-ad58-1cf0a991e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:13.790817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53647bb-96f1-498d-ad58-1cf0a991e441 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.791088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53647bb-96f1-498d-ad58-1cf0a991e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.791362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53647bb-96f1-498d-ad58-1cf0a991e441 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.792010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53647bb-96f1-498d-ad58-1cf0a991e441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:13.794058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53647bb-96f1-498d-ad58-1cf0a991e441 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:13.819819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1219/2422] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:30:13 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:30:13.823559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5332f-b3a9-41f0-8b07-a1e417b4ac0f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:13.837284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5332f-b3a9-41f0-8b07-a1e417b4ac0f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:13.843982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36eef-6d22-4e67-a7f5-74da5d1e9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:13.844670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36eef-6d22-4e67-a7f5-74da5d1e9f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.844957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36eef-6d22-4e67-a7f5-74da5d1e9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.845405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36eef-6d22-4e67-a7f5-74da5d1e9f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.846107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36eef-6d22-4e67-a7f5-74da5d1e9f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:13.847787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36eef-6d22-4e67-a7f5-74da5d1e9f7e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:13.862852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1204/2423] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:30:13.866775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53647bb-96f1-498d-ad58-1cf0a991e441 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:13.886876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53647bb-96f1-498d-ad58-1cf0a991e441 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:13.896731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ca2b-d2ba-41da-8478-715febfc815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:13.897476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ca2b-d2ba-41da-8478-715febfc815a admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.897889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ca2b-d2ba-41da-8478-715febfc815a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.898272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ca2b-d2ba-41da-8478-715febfc815a admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.899035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74ca2b-d2ba-41da-8478-715febfc815a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:13.900818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74ca2b-d2ba-41da-8478-715febfc815a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:13.913505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1220/2424] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:30:13.917654 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36eef-6d22-4e67-a7f5-74da5d1e9f7e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:13.929341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36eef-6d22-4e67-a7f5-74da5d1e9f7e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:13.934933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:13.935832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:13.936967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:13.937678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] PATH_INFO: `/v3/projects/aff63767d487447fb0cc97aab1b072f4/users/6cce0b1101de4512b1b0390527abf7e9/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:13.956197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff63767d487447fb0cc97aab1b072f4, user_id=6cce0b1101de4512b1b0390527abf7e9, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:13.960586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:13.986173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1205/2425] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:30:13 2022] PUT /identity/v3/projects/aff63767d487447fb0cc97aab1b072f4/users/6cce0b1101de4512b1b0390527abf7e9/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:30:14.052901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0fe6-4908-4ae0-bf22-1099f7f42fe2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:14.053417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0fe6-4908-4ae0-bf22-1099f7f42fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:14.053417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0fe6-4908-4ae0-bf22-1099f7f42fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:14.104942 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-371e0fe6-4908-4ae0-bf22-1099f7f42fe2 None None] MFA Rules not processed for user `6cce0b1101de4512b1b0390527abf7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:14.106406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-371e0fe6-4908-4ae0-bf22-1099f7f42fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:14.213738 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1221/2426] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:14.226652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:14.228377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:14.350261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ccd88-0e73-4155-bdeb-cb1a3bb4d162 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:14.354643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad7e4-ea4d-4ff4-949a-488371c249e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:14.355350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad7e4-ea4d-4ff4-949a-488371c249e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:14.355702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad7e4-ea4d-4ff4-949a-488371c249e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:14.355992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad7e4-ea4d-4ff4-949a-488371c249e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:14.367870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad7e4-ea4d-4ff4-949a-488371c249e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:14.369671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad7e4-ea4d-4ff4-949a-488371c249e4 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:14.383608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1206/2427] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:30:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:30:24.207414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:24.377953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=4,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:29.942502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b89b6-5e09-4896-8426-10229fd89f58 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:29.943119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b89b6-5e09-4896-8426-10229fd89f58 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:29.943119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b89b6-5e09-4896-8426-10229fd89f58 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:29.945086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1222/2428] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:30:29.952194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd0420-953e-4f4d-bbab-21e1787e631c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:29.952773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd0420-953e-4f4d-bbab-21e1787e631c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:29.952773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd0420-953e-4f4d-bbab-21e1787e631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:30.027712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-afbd0420-953e-4f4d-bbab-21e1787e631c None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:30.028964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-afbd0420-953e-4f4d-bbab-21e1787e631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:30.205652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1207/2429] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:30:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:30.216987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b89b6-5e09-4896-8426-10229fd89f58 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:30.219383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-396b89b6-5e09-4896-8426-10229fd89f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:30.285704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b89b6-5e09-4896-8426-10229fd89f58 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:30.289347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f34a8-8969-4e95-92ba-ee66477ef007 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:30.290036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f34a8-8969-4e95-92ba-ee66477ef007 service glance] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:30.290343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f34a8-8969-4e95-92ba-ee66477ef007 service glance] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:30.290619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f34a8-8969-4e95-92ba-ee66477ef007 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:30.303330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f34a8-8969-4e95-92ba-ee66477ef007 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:30.304820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f34a8-8969-4e95-92ba-ee66477ef007 service glance] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:30.319005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1223/2430] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:30:30.394285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe10e-c2cd-49d3-809f-10fd402fd02c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:30.394579 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe10e-c2cd-49d3-809f-10fd402fd02c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:30.394923 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe10e-c2cd-49d3-809f-10fd402fd02c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:30.396492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1208/2431] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 06 12:30:30.402102 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a078-a277-4f45-9d79-51bc4a0a49e1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:30.402388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a078-a277-4f45-9d79-51bc4a0a49e1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:30.402662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a078-a277-4f45-9d79-51bc4a0a49e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:30.426275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-13a9a078-a277-4f45-9d79-51bc4a0a49e1 None None] MFA Rules not processed for user `c8bc6ac1df7f4bd383fded2b9a22ecf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:30.427655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-13a9a078-a277-4f45-9d79-51bc4a0a49e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:30.486765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1224/2432] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:30:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:30.499939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe10e-c2cd-49d3-809f-10fd402fd02c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:30.501712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec5fe10e-c2cd-49d3-809f-10fd402fd02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:30.515614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe10e-c2cd-49d3-809f-10fd402fd02c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:30.519405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbaa094-ddd6-4055-84b4-b2d3a1936238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:30.520014 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaa094-ddd6-4055-84b4-b2d3a1936238 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:30.520298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaa094-ddd6-4055-84b4-b2d3a1936238 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:30.520571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaa094-ddd6-4055-84b4-b2d3a1936238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:30.529048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaa094-ddd6-4055-84b4-b2d3a1936238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:30.530744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaa094-ddd6-4055-84b4-b2d3a1936238 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:30.540058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1209/2433] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:30:30.631095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5083e-9ac0-4e34-8438-563d0d5ba514 None None] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:30.631459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5083e-9ac0-4e34-8438-563d0d5ba514 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:30.631794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5083e-9ac0-4e34-8438-563d0d5ba514 None None] PATH_INFO: `/` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:30.633229 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1225/2434] 10.222.0.15 () {54 vars in 921 bytes} [Thu Oct 6 12:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 06 12:30:30.639167 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86106a-866d-4e0d-9bc1-6603658d0f6f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:30.639496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86106a-866d-4e0d-9bc1-6603658d0f6f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:30.639815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86106a-866d-4e0d-9bc1-6603658d0f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:30.660731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-df86106a-866d-4e0d-9bc1-6603658d0f6f None None] MFA Rules not processed for user `1bd257708357455d99990b01af81e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:30.661992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df86106a-866d-4e0d-9bc1-6603658d0f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:30.672685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1210/2435] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Oct 6 12:30:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:30.683184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5083e-9ac0-4e34-8438-563d0d5ba514 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:30.694678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5083e-9ac0-4e34-8438-563d0d5ba514 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:30.698421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:30.699036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:30.699441 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:30.699578 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:30.713049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:30.715252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:30.727673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1226/2436] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:30:33.551170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1988c4-ff54-4187-8942-6d3f306cb43a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:33.551693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1988c4-ff54-4187-8942-6d3f306cb43a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:33.551816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1988c4-ff54-4187-8942-6d3f306cb43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:33.579686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bf1988c4-ff54-4187-8942-6d3f306cb43a None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:33.580937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bf1988c4-ff54-4187-8942-6d3f306cb43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:33.616942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:33.638628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1211/2437] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:33.651404 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:33.652922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:33.726919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a65802-9a32-4f92-87e6-ebc5db54f364 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:33.731892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10854a5-f293-4bb9-9a13-5d42116a98ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:33.732499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10854a5-f293-4bb9-9a13-5d42116a98ab service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:33.732777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10854a5-f293-4bb9-9a13-5d42116a98ab service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:33.733044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10854a5-f293-4bb9-9a13-5d42116a98ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:33.745270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10854a5-f293-4bb9-9a13-5d42116a98ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:33.746928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10854a5-f293-4bb9-9a13-5d42116a98ab service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:33.756068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1227/2438] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:30:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:30:43.634549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:43.752763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:56.645987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1988c4-ff54-4187-8942-6d3f306cb43a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:56.732577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1988c4-ff54-4187-8942-6d3f306cb43a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:56.737809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:56.738447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:56.738728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:56.738999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] PATH_INFO: `/v3/users/6cce0b1101de4512b1b0390527abf7e9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:56.740177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cce0b1101de4512b1b0390527abf7e9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:56.742148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:56.795352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cce0b1101de4512b1b0390527abf7e9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:56.796087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cce0b1101de4512b1b0390527abf7e9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:56.804248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cce0b1101de4512b1b0390527abf7e9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:56.817758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cce0b1101de4512b1b0390527abf7e9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:56.826737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cce0b1101de4512b1b0390527abf7e9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:56.833300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1212/2439] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:30:56 2022] DELETE /identity/v3/users/6cce0b1101de4512b1b0390527abf7e9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:30:56.838290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02dd1-4b81-4f81-a1b8-72c88991375d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:56.838892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02dd1-4b81-4f81-a1b8-72c88991375d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:56.838892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02dd1-4b81-4f81-a1b8-72c88991375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:56.884436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c0b02dd1-4b81-4f81-a1b8-72c88991375d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:56.886083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c0b02dd1-4b81-4f81-a1b8-72c88991375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:56.955650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1228/2440] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:30:56.965277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:56.967038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:57.048817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:57.061220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1ee38-2ce5-48ab-83d8-3bdddbaa5aca admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:57.065476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:57.066145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:57.066428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:57.066702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:57.076733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:57.078234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:57.089296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1213/2441] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:30:57.385939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02dd1-4b81-4f81-a1b8-72c88991375d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:57.387375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c0b02dd1-4b81-4f81-a1b8-72c88991375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:57.391895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:57.393855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:57.419359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02dd1-4b81-4f81-a1b8-72c88991375d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:57.429717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:57.430577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:57.431026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:57.431478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] PATH_INFO: `/v3/projects/aff63767d487447fb0cc97aab1b072f4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:57.432963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff63767d487447fb0cc97aab1b072f4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:57.436278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:57.507899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff63767d487447fb0cc97aab1b072f4', 'request_id': 'req-a34d4aa3-238c-4650-9a7f-401902da7175'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:57.515223 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff63767d487447fb0cc97aab1b072f4', 'request_id': 'req-a34d4aa3-238c-4650-9a7f-401902da7175'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:57.521881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff63767d487447fb0cc97aab1b072f4', 'request_id': 'req-a34d4aa3-238c-4650-9a7f-401902da7175'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:57.532947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa095c5-fc6c-45bd-9c98-0171d616009d service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:57.546135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] The token cache is being invalidate because project aff63767d487447fb0cc97aab1b072f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:30:57.546501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:57.547900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a34d4aa3-238c-4650-9a7f-401902da7175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:30:57.553028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1229/2442] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:30:57 2022] DELETE /identity/v3/projects/aff63767d487447fb0cc97aab1b072f4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:30:57.554485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1a05-b4f2-45b3-8233-681e11470190 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:57.554779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1a05-b4f2-45b3-8233-681e11470190 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:57.555064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1a05-b4f2-45b3-8233-681e11470190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:57.604430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7edc1a05-b4f2-45b3-8233-681e11470190 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:57.605685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7edc1a05-b4f2-45b3-8233-681e11470190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:57.612071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43647a3d-ef07-4f70-8efb-f738e0889da7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:57.612690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43647a3d-ef07-4f70-8efb-f738e0889da7 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:57.612977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43647a3d-ef07-4f70-8efb-f738e0889da7 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:57.613277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43647a3d-ef07-4f70-8efb-f738e0889da7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:57.615261 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-43647a3d-ef07-4f70-8efb-f738e0889da7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:57.628080 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43647a3d-ef07-4f70-8efb-f738e0889da7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:57.629856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43647a3d-ef07-4f70-8efb-f738e0889da7 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:57.641845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1214/2443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:30:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:30:57.660129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:57.682097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1230/2444] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:57.691110 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6e3c-546f-46c1-9cc6-de40ea4b7fde None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:57.691689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6e3c-546f-46c1-9cc6-de40ea4b7fde None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:57.691689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6e3c-546f-46c1-9cc6-de40ea4b7fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:57.711969 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7e8b6e3c-546f-46c1-9cc6-de40ea4b7fde None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:57.713121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e8b6e3c-546f-46c1-9cc6-de40ea4b7fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:57.723382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1215/2445] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:57.727818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1a05-b4f2-45b3-8233-681e11470190 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:57.739307 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1a05-b4f2-45b3-8233-681e11470190 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:57.744243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:57.744900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:57.745180 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:57.745461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:57.746151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:30:57.746452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:57.748980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:57.777567 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1231/2446] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:30:57.782668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6e3c-546f-46c1-9cc6-de40ea4b7fde None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:57.792432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6e3c-546f-46c1-9cc6-de40ea4b7fde None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:57.800955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792fdc8-69fc-45bb-96d7-cdfe034b73a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:57.801700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792fdc8-69fc-45bb-96d7-cdfe034b73a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:57.802057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792fdc8-69fc-45bb-96d7-cdfe034b73a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:57.802377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792fdc8-69fc-45bb-96d7-cdfe034b73a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:57.803198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792fdc8-69fc-45bb-96d7-cdfe034b73a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:57.805099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792fdc8-69fc-45bb-96d7-cdfe034b73a8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:57.857109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1216/2447] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:30:57 2022] POST /identity/v3/projects => generated 391 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:30:57.859802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:57.878827 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4773-c886-483a-a616-518c020bbb33 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:57.947831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aa22c-1b2a-4085-bae9-829c6f5ef801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:57.948497 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa22c-1b2a-4085-bae9-829c6f5ef801 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:57.948811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa22c-1b2a-4085-bae9-829c6f5ef801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:57.949112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa22c-1b2a-4085-bae9-829c6f5ef801 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:57.949862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aa22c-1b2a-4085-bae9-829c6f5ef801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:57.953224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aa22c-1b2a-4085-bae9-829c6f5ef801 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:57.983621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1232/2448] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:30:57 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:30:57.988020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792fdc8-69fc-45bb-96d7-cdfe034b73a8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:58.001141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792fdc8-69fc-45bb-96d7-cdfe034b73a8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:58.006076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488069e-79dc-48b5-bfa5-16eab785ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:58.006799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488069e-79dc-48b5-bfa5-16eab785ed2c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:58.007148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488069e-79dc-48b5-bfa5-16eab785ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:58.007429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488069e-79dc-48b5-bfa5-16eab785ed2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:58.008086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488069e-79dc-48b5-bfa5-16eab785ed2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:58.009992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488069e-79dc-48b5-bfa5-16eab785ed2c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:58.021728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1217/2449] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:30:58.025869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aa22c-1b2a-4085-bae9-829c6f5ef801 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:58.036698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aa22c-1b2a-4085-bae9-829c6f5ef801 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:58.042247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6696db-4e23-41d0-8f11-68a8fdd84cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:58.042864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6696db-4e23-41d0-8f11-68a8fdd84cca admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:58.043144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6696db-4e23-41d0-8f11-68a8fdd84cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:58.043421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6696db-4e23-41d0-8f11-68a8fdd84cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:58.044084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6696db-4e23-41d0-8f11-68a8fdd84cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:58.046142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6696db-4e23-41d0-8f11-68a8fdd84cca admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:58.058889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1233/2450] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:30:58.064154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488069e-79dc-48b5-bfa5-16eab785ed2c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:58.074554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488069e-79dc-48b5-bfa5-16eab785ed2c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:58.079867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:58.080523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:58.080833 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:58.081235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] PATH_INFO: `/v3/projects/b34935d146e6448fa2ac49d02e55cc73/users/e937cf5e72124011bd0d7e4b68fe761e/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:58.096920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34935d146e6448fa2ac49d02e55cc73, user_id=e937cf5e72124011bd0d7e4b68fe761e, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:58.099644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:58.102120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:30:58.114027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1218/2451] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:30:58 2022] PUT /identity/v3/projects/b34935d146e6448fa2ac49d02e55cc73/users/e937cf5e72124011bd0d7e4b68fe761e/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:30:58.126172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525479a-e4b0-4def-a27d-85b169800591 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:58.126460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525479a-e4b0-4def-a27d-85b169800591 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:58.126753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525479a-e4b0-4def-a27d-85b169800591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:58.157743 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3525479a-e4b0-4def-a27d-85b169800591 None None] MFA Rules not processed for user `e937cf5e72124011bd0d7e4b68fe761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:30:58.158968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3525479a-e4b0-4def-a27d-85b169800591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:58.227492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1234/2452] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:30:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:30:58.238300 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:30:58.240006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:30:58.320117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38004c0-98e4-467b-bbb6-b4a037ede285 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:30:58.323874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:30:58.324479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:30:58.324768 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:30:58.325045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:30:58.334022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:30:58.335462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:30:58.344932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1219/2453] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:30:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:00.979226 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071de29b-182a-4bd9-8bb1-c0c482bc4020 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:00.979623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071de29b-182a-4bd9-8bb1-c0c482bc4020 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:00.979813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071de29b-182a-4bd9-8bb1-c0c482bc4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:00.999864 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-071de29b-182a-4bd9-8bb1-c0c482bc4020 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:01.001168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-071de29b-182a-4bd9-8bb1-c0c482bc4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:01.046181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:01.062915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1235/2454] 10.222.0.15 () {58 vars in 967 bytes} [Thu Oct 6 12:31:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:01.077272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:01.078730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:01.161119 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec426-2a1d-479d-a42b-cea36eb6589a service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:01.167664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9c1fa-d2e6-4a45-a513-798d213f37f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:01.168322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9c1fa-d2e6-4a45-a513-798d213f37f9 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:01.168489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9c1fa-d2e6-4a45-a513-798d213f37f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:01.170220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9c1fa-d2e6-4a45-a513-798d213f37f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:01.183251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9c1fa-d2e6-4a45-a513-798d213f37f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:01.197671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9c1fa-d2e6-4a45-a513-798d213f37f9 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:01.197671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1220/2455] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:31:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:31:08.614674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071de29b-182a-4bd9-8bb1-c0c482bc4020 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:08.685908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071de29b-182a-4bd9-8bb1-c0c482bc4020 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:08.690605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:08.691252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:08.691539 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:08.691810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] PATH_INFO: `/v3/users/e937cf5e72124011bd0d7e4b68fe761e` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:08.692944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e937cf5e72124011bd0d7e4b68fe761e)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:08.694933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:08.758822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e937cf5e72124011bd0d7e4b68fe761e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:08.761129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e937cf5e72124011bd0d7e4b68fe761e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:08.761924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e937cf5e72124011bd0d7e4b68fe761e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:08.781936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e937cf5e72124011bd0d7e4b68fe761e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:08.790638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e937cf5e72124011bd0d7e4b68fe761e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:08.816641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1236/2456] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:08 2022] DELETE /identity/v3/users/e937cf5e72124011bd0d7e4b68fe761e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:08.822282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8636af-9d8b-4c88-94a8-61c5321e9e98 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:08.822845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8636af-9d8b-4c88-94a8-61c5321e9e98 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:08.823055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8636af-9d8b-4c88-94a8-61c5321e9e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:08.845319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ae8636af-9d8b-4c88-94a8-61c5321e9e98 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:08.846645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ae8636af-9d8b-4c88-94a8-61c5321e9e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:08.915907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1221/2457] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:08.926375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:08.927795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:08.997187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b11399-e456-47cd-b14b-c5a033214f9a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:09.001504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236496a-6958-4d21-ad57-a1a95dd05964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:09.002175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236496a-6958-4d21-ad57-a1a95dd05964 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:09.002454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236496a-6958-4d21-ad57-a1a95dd05964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:09.002813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236496a-6958-4d21-ad57-a1a95dd05964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:09.013117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236496a-6958-4d21-ad57-a1a95dd05964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:09.014619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236496a-6958-4d21-ad57-a1a95dd05964 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:09.024587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1237/2458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:09.317727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8636af-9d8b-4c88-94a8-61c5321e9e98 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:09.319541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ae8636af-9d8b-4c88-94a8-61c5321e9e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:09.331927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8636af-9d8b-4c88-94a8-61c5321e9e98 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:09.336990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:09.337665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:09.337948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:09.338225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] PATH_INFO: `/v3/projects/b34935d146e6448fa2ac49d02e55cc73` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:09.339363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34935d146e6448fa2ac49d02e55cc73)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:09.342212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:09.343877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:09.392217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34935d146e6448fa2ac49d02e55cc73', 'request_id': 'req-6cb9e986-8011-45bd-956e-b7f80f31ad61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:09.401090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34935d146e6448fa2ac49d02e55cc73', 'request_id': 'req-6cb9e986-8011-45bd-956e-b7f80f31ad61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:09.409246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34935d146e6448fa2ac49d02e55cc73', 'request_id': 'req-6cb9e986-8011-45bd-956e-b7f80f31ad61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:09.423240 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] The token cache is being invalidate because project b34935d146e6448fa2ac49d02e55cc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:09.423763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:09.424585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:09.426382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1222/2459] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:09 2022] DELETE /identity/v3/projects/b34935d146e6448fa2ac49d02e55cc73 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:17.638941 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236496a-6958-4d21-ad57-a1a95dd05964 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:17.647796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236496a-6958-4d21-ad57-a1a95dd05964 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:17.657286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:17.699311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:17.699831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:17.700116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:17.700395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:17.702205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:17.764522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:17.765993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:17.775742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1238/2460] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:19.418630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:21.205569 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:21.207108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:21.221703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9e986-8011-45bd-956e-b7f80f31ad61 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:21.226394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:21.227050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:21.227335 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:21.227609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] PATH_INFO: `/v3/users/8f1e7d78567844e4a1fa2d969a4f4821` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:21.228781 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1e7d78567844e4a1fa2d969a4f4821)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:21.231357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:21.293312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1e7d78567844e4a1fa2d969a4f4821'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.295478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1e7d78567844e4a1fa2d969a4f4821'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.305444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1e7d78567844e4a1fa2d969a4f4821'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.318434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1e7d78567844e4a1fa2d969a4f4821'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.326241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fbe21845-512b-4145-9580-4f76c66dc729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1e7d78567844e4a1fa2d969a4f4821'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.332312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1223/2461] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:21 2022] DELETE /identity/v3/users/8f1e7d78567844e4a1fa2d969a4f4821 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:21.507911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:21.522576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26c20e-ea1d-4c36-9cb6-b2887e3b1caa service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:21.585422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:21.586097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:21.586382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:21.586656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] PATH_INFO: `/v3/projects/e90cbcbf38dd4492888f59e552ae1f16` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:21.587906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90cbcbf38dd4492888f59e552ae1f16)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:21.591340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:21.642111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90cbcbf38dd4492888f59e552ae1f16', 'request_id': 'req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.648587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90cbcbf38dd4492888f59e552ae1f16', 'request_id': 'req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.654889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90cbcbf38dd4492888f59e552ae1f16', 'request_id': 'req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.657341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:21.670927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] The token cache is being invalidate because project e90cbcbf38dd4492888f59e552ae1f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:21.671300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.671956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cfc04ef3-83ad-463e-a6fa-e1481e0306d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:21.676832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1239/2462] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:21 2022] DELETE /identity/v3/projects/e90cbcbf38dd4492888f59e552ae1f16 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:21.678579 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376a59-df24-42fc-b1f0-edfc3a9e27c8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:21.678943 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376a59-df24-42fc-b1f0-edfc3a9e27c8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:21.679258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376a59-df24-42fc-b1f0-edfc3a9e27c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:21.699461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0e376a59-df24-42fc-b1f0-edfc3a9e27c8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:21.700793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0e376a59-df24-42fc-b1f0-edfc3a9e27c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:21.764396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1224/2463] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:21.772305 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2788f4-a7e7-466c-8a12-a1c4ba8cc0dc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:21.772621 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2788f4-a7e7-466c-8a12-a1c4ba8cc0dc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:21.772897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2788f4-a7e7-466c-8a12-a1c4ba8cc0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:21.794439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ad2788f4-a7e7-466c-8a12-a1c4ba8cc0dc None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:21.795652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ad2788f4-a7e7-466c-8a12-a1c4ba8cc0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:21.803638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1240/2464] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:21.807999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e376a59-df24-42fc-b1f0-edfc3a9e27c8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:21.818049 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e376a59-df24-42fc-b1f0-edfc3a9e27c8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:21.822609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:21.823213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:21.824447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:21.824580 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:21.825152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:31:21.825458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:21.827082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:21.840946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1225/2465] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:31:21.844606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2788f4-a7e7-466c-8a12-a1c4ba8cc0dc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:21.854103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2788f4-a7e7-466c-8a12-a1c4ba8cc0dc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:21.859399 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b804-9e5b-43a4-b44b-17d1ea9ce0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:21.860035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b804-9e5b-43a4-b44b-17d1ea9ce0ea admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:21.860316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b804-9e5b-43a4-b44b-17d1ea9ce0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:21.860591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79b804-9e5b-43a4-b44b-17d1ea9ce0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:21.861260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79b804-9e5b-43a4-b44b-17d1ea9ce0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:21.863311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79b804-9e5b-43a4-b44b-17d1ea9ce0ea admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:21.890357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1241/2466] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:31:21 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:21.894574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:21.905422 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff91fd-ebc3-4fe4-8ef3-91d026eeba45 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:21.961826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532f372-b9f9-4bf8-b887-e16d67ae5178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:21.962344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f372-b9f9-4bf8-b887-e16d67ae5178 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:21.962625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f372-b9f9-4bf8-b887-e16d67ae5178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:21.962900 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f372-b9f9-4bf8-b887-e16d67ae5178 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:21.963541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532f372-b9f9-4bf8-b887-e16d67ae5178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:21.966092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532f372-b9f9-4bf8-b887-e16d67ae5178 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:21.973929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:21.990528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1226/2467] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:31:21 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:21.994764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b804-9e5b-43a4-b44b-17d1ea9ce0ea admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:22.005595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79b804-9e5b-43a4-b44b-17d1ea9ce0ea admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:22.010452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332cbc5-e9ba-43ec-88f9-d03003620a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:22.011616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332cbc5-e9ba-43ec-88f9-d03003620a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:22.011891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332cbc5-e9ba-43ec-88f9-d03003620a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:22.012299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332cbc5-e9ba-43ec-88f9-d03003620a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:22.012894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332cbc5-e9ba-43ec-88f9-d03003620a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:22.014535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332cbc5-e9ba-43ec-88f9-d03003620a37 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:22.024946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1242/2468] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:22.029182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532f372-b9f9-4bf8-b887-e16d67ae5178 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:22.039322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532f372-b9f9-4bf8-b887-e16d67ae5178 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:22.044692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21151a71-01b9-46ad-ba07-cd6d1667df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:22.045297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21151a71-01b9-46ad-ba07-cd6d1667df91 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:22.045665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21151a71-01b9-46ad-ba07-cd6d1667df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:22.045946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21151a71-01b9-46ad-ba07-cd6d1667df91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:22.046609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21151a71-01b9-46ad-ba07-cd6d1667df91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:22.048220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21151a71-01b9-46ad-ba07-cd6d1667df91 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:22.060431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1227/2469] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:22.064756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332cbc5-e9ba-43ec-88f9-d03003620a37 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:22.075847 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332cbc5-e9ba-43ec-88f9-d03003620a37 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:22.080500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:22.081154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:22.081436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:22.081766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] PATH_INFO: `/v3/projects/20e3fdec07374dbeb36e8ee2616f83f0/users/f5ffbe38fcfa4a968f5cba76ed6bc29e/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:22.098069 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e3fdec07374dbeb36e8ee2616f83f0, user_id=f5ffbe38fcfa4a968f5cba76ed6bc29e, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:22.100793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:22.114283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1243/2470] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:22 2022] PUT /identity/v3/projects/20e3fdec07374dbeb36e8ee2616f83f0/users/f5ffbe38fcfa4a968f5cba76ed6bc29e/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:22.128238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3a0cb-8da8-4645-ab7f-063391a70274 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:22.128528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3a0cb-8da8-4645-ab7f-063391a70274 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:22.128808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3a0cb-8da8-4645-ab7f-063391a70274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:22.156871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-31f3a0cb-8da8-4645-ab7f-063391a70274 None None] MFA Rules not processed for user `f5ffbe38fcfa4a968f5cba76ed6bc29e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:22.158133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-31f3a0cb-8da8-4645-ab7f-063391a70274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:22.223469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1228/2471] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:22.235218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:22.236908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:22.310136 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6123e3-20ce-4eca-890d-c89fe84affa7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:22.315695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dafde-79e4-4271-8101-0513d529d15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:22.316300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dafde-79e4-4271-8101-0513d529d15a service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:22.316580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dafde-79e4-4271-8101-0513d529d15a service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:22.316856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dafde-79e4-4271-8101-0513d529d15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:22.326041 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dafde-79e4-4271-8101-0513d529d15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:22.327648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dafde-79e4-4271-8101-0513d529d15a service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:22.336815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1244/2472] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:25.022774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3a0cb-8da8-4645-ab7f-063391a70274 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:25.084005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3a0cb-8da8-4645-ab7f-063391a70274 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:25.095187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:25.095847 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:25.096136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:25.096416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] PATH_INFO: `/v3/users/f5ffbe38fcfa4a968f5cba76ed6bc29e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:25.097598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ffbe38fcfa4a968f5cba76ed6bc29e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:25.099540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:25.149716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ffbe38fcfa4a968f5cba76ed6bc29e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.150369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ffbe38fcfa4a968f5cba76ed6bc29e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.158535 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ffbe38fcfa4a968f5cba76ed6bc29e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.170520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:25.171767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ffbe38fcfa4a968f5cba76ed6bc29e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.180823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ffbe38fcfa4a968f5cba76ed6bc29e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.186886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1229/2473] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:25 2022] DELETE /identity/v3/users/f5ffbe38fcfa4a968f5cba76ed6bc29e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:31:25.191309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950d23-1208-47d8-86cb-afa489469964 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:25.191794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950d23-1208-47d8-86cb-afa489469964 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:25.191896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950d23-1208-47d8-86cb-afa489469964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:25.211351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c3950d23-1208-47d8-86cb-afa489469964 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:25.212545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c3950d23-1208-47d8-86cb-afa489469964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:25.271752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1245/2474] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:25.282028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:25.283430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:25.342451 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451115f4-65e6-4277-a8d1-127c6b0f8664 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:25.346079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c142f95-0235-4431-a5b5-7a54728c6efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:25.346686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142f95-0235-4431-a5b5-7a54728c6efc service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:25.346968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142f95-0235-4431-a5b5-7a54728c6efc service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:25.347244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142f95-0235-4431-a5b5-7a54728c6efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:25.356209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c142f95-0235-4431-a5b5-7a54728c6efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:25.357677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c142f95-0235-4431-a5b5-7a54728c6efc service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:25.366997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1230/2475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:25.637465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950d23-1208-47d8-86cb-afa489469964 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:25.638922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c3950d23-1208-47d8-86cb-afa489469964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:25.651507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950d23-1208-47d8-86cb-afa489469964 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:25.656209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:25.656844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:25.657124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:25.657397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] PATH_INFO: `/v3/projects/20e3fdec07374dbeb36e8ee2616f83f0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:25.658562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e3fdec07374dbeb36e8ee2616f83f0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:25.660490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:25.671872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:25.708481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e3fdec07374dbeb36e8ee2616f83f0', 'request_id': 'req-6034ab81-cecd-445a-b011-8f97dc80188e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.715325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e3fdec07374dbeb36e8ee2616f83f0', 'request_id': 'req-6034ab81-cecd-445a-b011-8f97dc80188e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.720866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e3fdec07374dbeb36e8ee2616f83f0', 'request_id': 'req-6034ab81-cecd-445a-b011-8f97dc80188e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.734591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] The token cache is being invalidate because project 20e3fdec07374dbeb36e8ee2616f83f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:25.734871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.735589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6034ab81-cecd-445a-b011-8f97dc80188e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:25.737337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1246/2476] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:25 2022] DELETE /identity/v3/projects/20e3fdec07374dbeb36e8ee2616f83f0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:25.742282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cfedb-0b42-4e11-a999-6692f02b456d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:25.742571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cfedb-0b42-4e11-a999-6692f02b456d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:25.742846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cfedb-0b42-4e11-a999-6692f02b456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:25.762389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8c9cfedb-0b42-4e11-a999-6692f02b456d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:25.763628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8c9cfedb-0b42-4e11-a999-6692f02b456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:25.822260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1231/2477] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:25.830084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ed84c-5783-4d22-b7c7-39c6b916deff None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:25.830386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ed84c-5783-4d22-b7c7-39c6b916deff None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:25.830656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ed84c-5783-4d22-b7c7-39c6b916deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:25.851845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-572ed84c-5783-4d22-b7c7-39c6b916deff None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:25.853091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-572ed84c-5783-4d22-b7c7-39c6b916deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:25.862063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1247/2478] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:25.866500 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cfedb-0b42-4e11-a999-6692f02b456d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:25.876481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cfedb-0b42-4e11-a999-6692f02b456d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:25.881145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:25.881785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:25.882071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:25.882343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:25.882995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:31:25.883553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:25.885134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:25.896921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1232/2479] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:31:25.901887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ed84c-5783-4d22-b7c7-39c6b916deff None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:25.911330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ed84c-5783-4d22-b7c7-39c6b916deff None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:25.915947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a95eb-9b87-4590-aed1-7990b69c2f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:25.916543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a95eb-9b87-4590-aed1-7990b69c2f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:25.917432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a95eb-9b87-4590-aed1-7990b69c2f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:25.917739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a95eb-9b87-4590-aed1-7990b69c2f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:25.918370 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a95eb-9b87-4590-aed1-7990b69c2f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:25.920268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a95eb-9b87-4590-aed1-7990b69c2f8d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:25.946706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1248/2480] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:31:25 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:25.950966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:25.961184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07260e6f-85b4-4ce5-b5d8-91e025903299 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.017345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703608be-9acc-408b-8b2f-03eb254e8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.017975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703608be-9acc-408b-8b2f-03eb254e8cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.018258 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703608be-9acc-408b-8b2f-03eb254e8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.018533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703608be-9acc-408b-8b2f-03eb254e8cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.019169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703608be-9acc-408b-8b2f-03eb254e8cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.021178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703608be-9acc-408b-8b2f-03eb254e8cc7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.043492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1233/2481] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:31:25 2022] POST /identity/v3/users => generated 279 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:26.047668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a95eb-9b87-4590-aed1-7990b69c2f8d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.058261 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a95eb-9b87-4590-aed1-7990b69c2f8d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.067082 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f255-79e6-4f59-b94f-278c75b9e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.067685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f255-79e6-4f59-b94f-278c75b9e645 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.068015 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f255-79e6-4f59-b94f-278c75b9e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.068288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f255-79e6-4f59-b94f-278c75b9e645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.068929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09f255-79e6-4f59-b94f-278c75b9e645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.070554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09f255-79e6-4f59-b94f-278c75b9e645 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.081285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1249/2482] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:26.085275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703608be-9acc-408b-8b2f-03eb254e8cc7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.096006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703608be-9acc-408b-8b2f-03eb254e8cc7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.100617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a29f3e-f7f4-4533-a1fd-34180674d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.101215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29f3e-f7f4-4533-a1fd-34180674d4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.101496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29f3e-f7f4-4533-a1fd-34180674d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.101804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29f3e-f7f4-4533-a1fd-34180674d4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.102449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a29f3e-f7f4-4533-a1fd-34180674d4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.104032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a29f3e-f7f4-4533-a1fd-34180674d4e6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.105371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:26.116613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1234/2483] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:26.120970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f255-79e6-4f59-b94f-278c75b9e645 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.131159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f255-79e6-4f59-b94f-278c75b9e645 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.136872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e38a1-9d37-4ef8-89f8-00bb12b1f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.137545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e38a1-9d37-4ef8-89f8-00bb12b1f18f admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.137832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e38a1-9d37-4ef8-89f8-00bb12b1f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.138100 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e38a1-9d37-4ef8-89f8-00bb12b1f18f admin admin] PATH_INFO: `/v3/projects/4833cd8b02eb410891c1e05b749483c3/users/38083c5a1c194a898d02caa6c7a8a3c5/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.153636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e38a1-9d37-4ef8-89f8-00bb12b1f18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4833cd8b02eb410891c1e05b749483c3, user_id=38083c5a1c194a898d02caa6c7a8a3c5, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.156301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e38a1-9d37-4ef8-89f8-00bb12b1f18f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.170338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1250/2484] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:26 2022] PUT /identity/v3/projects/4833cd8b02eb410891c1e05b749483c3/users/38083c5a1c194a898d02caa6c7a8a3c5/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:26.180852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1af397-4129-442c-b172-87e31a1368f3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.181141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1af397-4129-442c-b172-87e31a1368f3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.181444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1af397-4129-442c-b172-87e31a1368f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.211823 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-de1af397-4129-442c-b172-87e31a1368f3 None None] MFA Rules not processed for user `38083c5a1c194a898d02caa6c7a8a3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:26.213038 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de1af397-4129-442c-b172-87e31a1368f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:26.277854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1235/2485] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:26.282445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e38a1-9d37-4ef8-89f8-00bb12b1f18f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.343425 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e38a1-9d37-4ef8-89f8-00bb12b1f18f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.347990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c581fa-7a09-4e72-8ba6-067aaa731700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.348592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c581fa-7a09-4e72-8ba6-067aaa731700 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.348877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c581fa-7a09-4e72-8ba6-067aaa731700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.349151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c581fa-7a09-4e72-8ba6-067aaa731700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.349815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c581fa-7a09-4e72-8ba6-067aaa731700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.351719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c581fa-7a09-4e72-8ba6-067aaa731700 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.377768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1251/2486] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:31:26 2022] POST /identity/v3/projects => generated 355 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:26.382005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1af397-4129-442c-b172-87e31a1368f3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.393324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1af397-4129-442c-b172-87e31a1368f3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.451668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0fe14-6a97-414f-95c9-0912a97fb34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.452281 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0fe14-6a97-414f-95c9-0912a97fb34d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.452568 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0fe14-6a97-414f-95c9-0912a97fb34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.452845 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0fe14-6a97-414f-95c9-0912a97fb34d admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.453495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0fe14-6a97-414f-95c9-0912a97fb34d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.455456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0fe14-6a97-414f-95c9-0912a97fb34d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.476541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1236/2487] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:31:26 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:26.480943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c581fa-7a09-4e72-8ba6-067aaa731700 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.491260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c581fa-7a09-4e72-8ba6-067aaa731700 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.496543 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f50d62-a49a-4ecf-86d5-d0b5b234919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.497131 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50d62-a49a-4ecf-86d5-d0b5b234919f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.497411 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50d62-a49a-4ecf-86d5-d0b5b234919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.497722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50d62-a49a-4ecf-86d5-d0b5b234919f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.498362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f50d62-a49a-4ecf-86d5-d0b5b234919f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.499971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f50d62-a49a-4ecf-86d5-d0b5b234919f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.510902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1252/2488] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:26.515040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0fe14-6a97-414f-95c9-0912a97fb34d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.524872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0fe14-6a97-414f-95c9-0912a97fb34d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.530169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0cfb2-1df2-4f6c-bde5-680c4bf3bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.530831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0cfb2-1df2-4f6c-bde5-680c4bf3bacf admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.531112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0cfb2-1df2-4f6c-bde5-680c4bf3bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.531387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0cfb2-1df2-4f6c-bde5-680c4bf3bacf admin admin] PATH_INFO: `/v3/projects/847748836bd34a4b833f064237b98de6/users/12c3bbed54424a94b9d6b8b7618c69b3/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.546787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0cfb2-1df2-4f6c-bde5-680c4bf3bacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=847748836bd34a4b833f064237b98de6, user_id=12c3bbed54424a94b9d6b8b7618c69b3, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.549440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0cfb2-1df2-4f6c-bde5-680c4bf3bacf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.564437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1237/2489] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:26 2022] PUT /identity/v3/projects/847748836bd34a4b833f064237b98de6/users/12c3bbed54424a94b9d6b8b7618c69b3/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:26.568420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f50d62-a49a-4ecf-86d5-d0b5b234919f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.578782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f50d62-a49a-4ecf-86d5-d0b5b234919f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.583487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:26.639722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33146acb-35c2-4870-b9c3-195925c885c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.640323 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146acb-35c2-4870-b9c3-195925c885c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.640599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146acb-35c2-4870-b9c3-195925c885c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.640867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146acb-35c2-4870-b9c3-195925c885c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.641529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33146acb-35c2-4870-b9c3-195925c885c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.643176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33146acb-35c2-4870-b9c3-195925c885c9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.653811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1253/2490] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:26.658387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0cfb2-1df2-4f6c-bde5-680c4bf3bacf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.669604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0cfb2-1df2-4f6c-bde5-680c4bf3bacf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.674532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.675005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.675292 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.675577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] PATH_INFO: `/v3/projects/847748836bd34a4b833f064237b98de6/users/12c3bbed54424a94b9d6b8b7618c69b3/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.677516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847748836bd34a4b833f064237b98de6, user_id=12c3bbed54424a94b9d6b8b7618c69b3, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.680207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.691509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1238/2491] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:26 2022] PUT /identity/v3/projects/847748836bd34a4b833f064237b98de6/users/12c3bbed54424a94b9d6b8b7618c69b3/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:26.703251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948552d-ae3b-40fe-9bc4-462886588553 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.703532 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948552d-ae3b-40fe-9bc4-462886588553 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.703835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948552d-ae3b-40fe-9bc4-462886588553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.732498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1948552d-ae3b-40fe-9bc4-462886588553 None None] MFA Rules not processed for user `12c3bbed54424a94b9d6b8b7618c69b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:26.733749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1948552d-ae3b-40fe-9bc4-462886588553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:26.803718 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1254/2492] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:26.815484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.817242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:26.860577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:26.876656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a46e91-c6e5-430a-b3a4-cd6f17c9b3c2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.880387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943464a4-c7c3-4004-a437-0f0f9eb65b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.881095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943464a4-c7c3-4004-a437-0f0f9eb65b41 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.881277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943464a4-c7c3-4004-a437-0f0f9eb65b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:26.881582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943464a4-c7c3-4004-a437-0f0f9eb65b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:26.891879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943464a4-c7c3-4004-a437-0f0f9eb65b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:26.893248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943464a4-c7c3-4004-a437-0f0f9eb65b41 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:26.903237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1239/2493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:26.985375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948552d-ae3b-40fe-9bc4-462886588553 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:26.995364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948552d-ae3b-40fe-9bc4-462886588553 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:26.999034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5a7fa-8e96-4079-8a1f-71e7e6879259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:26.999625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5a7fa-8e96-4079-8a1f-71e7e6879259 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:26.999902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5a7fa-8e96-4079-8a1f-71e7e6879259 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:27.000175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5a7fa-8e96-4079-8a1f-71e7e6879259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:27.057124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5a7fa-8e96-4079-8a1f-71e7e6879259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:27.058803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5a7fa-8e96-4079-8a1f-71e7e6879259 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:27.067675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1255/2494] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:36.898458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:37.063644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:42.240541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943464a4-c7c3-4004-a437-0f0f9eb65b41 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:42.305808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943464a4-c7c3-4004-a437-0f0f9eb65b41 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:42.310349 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:42.311011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:42.311293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:42.311588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] PATH_INFO: `/v3/users/38083c5a1c194a898d02caa6c7a8a3c5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:42.312699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38083c5a1c194a898d02caa6c7a8a3c5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:42.314675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:42.360405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38083c5a1c194a898d02caa6c7a8a3c5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.361065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38083c5a1c194a898d02caa6c7a8a3c5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.369337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38083c5a1c194a898d02caa6c7a8a3c5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.381396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38083c5a1c194a898d02caa6c7a8a3c5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.388596 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38083c5a1c194a898d02caa6c7a8a3c5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.395858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1240/2495] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:42 2022] DELETE /identity/v3/users/38083c5a1c194a898d02caa6c7a8a3c5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:31:42.400347 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75350ae1-ef47-4ec5-8c82-321688ffe050 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:42.400804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75350ae1-ef47-4ec5-8c82-321688ffe050 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:42.400902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75350ae1-ef47-4ec5-8c82-321688ffe050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:42.419787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-75350ae1-ef47-4ec5-8c82-321688ffe050 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:42.421040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-75350ae1-ef47-4ec5-8c82-321688ffe050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:42.482502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1256/2496] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:31:42.492586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:42.494032 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:42.551787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cea63-9390-4bf9-adf0-ab7a559d113e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:42.555815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931e55-12aa-4a34-9263-ba120946bb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:42.556418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931e55-12aa-4a34-9263-ba120946bb25 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:42.556706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931e55-12aa-4a34-9263-ba120946bb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:42.556978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931e55-12aa-4a34-9263-ba120946bb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:42.566828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931e55-12aa-4a34-9263-ba120946bb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:42.568244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931e55-12aa-4a34-9263-ba120946bb25 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:42.578268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1241/2497] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:42.849901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75350ae1-ef47-4ec5-8c82-321688ffe050 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:42.851462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-75350ae1-ef47-4ec5-8c82-321688ffe050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:42.866649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75350ae1-ef47-4ec5-8c82-321688ffe050 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:42.872341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:42.873883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:42.875014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:42.875188 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] PATH_INFO: `/v3/projects/4833cd8b02eb410891c1e05b749483c3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:42.877063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4833cd8b02eb410891c1e05b749483c3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:42.880511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:42.930874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4833cd8b02eb410891c1e05b749483c3', 'request_id': 'req-89f7bb7d-029f-4124-8b1c-4b750b90c497'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.937948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4833cd8b02eb410891c1e05b749483c3', 'request_id': 'req-89f7bb7d-029f-4124-8b1c-4b750b90c497'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.943607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4833cd8b02eb410891c1e05b749483c3', 'request_id': 'req-89f7bb7d-029f-4124-8b1c-4b750b90c497'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.956259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] The token cache is being invalidate because project 4833cd8b02eb410891c1e05b749483c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:42.956546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.957165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:42.958665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1257/2498] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:42 2022] DELETE /identity/v3/projects/4833cd8b02eb410891c1e05b749483c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:42.962666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931e55-12aa-4a34-9263-ba120946bb25 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:42.972890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931e55-12aa-4a34-9263-ba120946bb25 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:42.991963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:43.031858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:43.032480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.032764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.033087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] PATH_INFO: `/v3/users/12c3bbed54424a94b9d6b8b7618c69b3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.034216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c3bbed54424a94b9d6b8b7618c69b3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:43.036170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:43.082634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c3bbed54424a94b9d6b8b7618c69b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.083283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c3bbed54424a94b9d6b8b7618c69b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.090714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c3bbed54424a94b9d6b8b7618c69b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.103820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c3bbed54424a94b9d6b8b7618c69b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.111165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed9acfb-a7da-4a04-a764-440bbacd8c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c3bbed54424a94b9d6b8b7618c69b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.117005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1242/2499] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:42 2022] DELETE /identity/v3/users/12c3bbed54424a94b9d6b8b7618c69b3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:43.393680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:43.395173 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:43.408891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7bb7d-029f-4124-8b1c-4b750b90c497 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:43.468493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:43.469250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.469545 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.469835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] PATH_INFO: `/v3/projects/847748836bd34a4b833f064237b98de6` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.472785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847748836bd34a4b833f064237b98de6)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:43.474947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:43.510974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:43.528787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847748836bd34a4b833f064237b98de6', 'request_id': 'req-04dc9d5f-5463-4c0f-9294-af909e0f7b74'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.535396 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847748836bd34a4b833f064237b98de6', 'request_id': 'req-04dc9d5f-5463-4c0f-9294-af909e0f7b74'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.540770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847748836bd34a4b833f064237b98de6', 'request_id': 'req-04dc9d5f-5463-4c0f-9294-af909e0f7b74'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.554722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] The token cache is being invalidate because project 847748836bd34a4b833f064237b98de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:43.555235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.556070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-04dc9d5f-5463-4c0f-9294-af909e0f7b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:43.558051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1258/2500] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:43 2022] DELETE /identity/v3/projects/847748836bd34a4b833f064237b98de6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:43.563029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10033f83-05e4-4836-93d6-cf678a624d29 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.563493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10033f83-05e4-4836-93d6-cf678a624d29 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.563588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10033f83-05e4-4836-93d6-cf678a624d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.583480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-10033f83-05e4-4836-93d6-cf678a624d29 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:43.584698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10033f83-05e4-4836-93d6-cf678a624d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:43.644599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1243/2501] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:43.652512 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf37e4-3744-4bec-b377-5dbcec9d867a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.652795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf37e4-3744-4bec-b377-5dbcec9d867a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.653064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf37e4-3744-4bec-b377-5dbcec9d867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.673673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-cabf37e4-3744-4bec-b377-5dbcec9d867a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:43.674894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cabf37e4-3744-4bec-b377-5dbcec9d867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:43.682950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1259/2502] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:31:43.687844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10033f83-05e4-4836-93d6-cf678a624d29 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:43.697550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10033f83-05e4-4836-93d6-cf678a624d29 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:43.702681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:43.703272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.703557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.703834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.704486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:31:43.704794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:43.706430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:43.718257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1244/2503] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:31:43.722358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf37e4-3744-4bec-b377-5dbcec9d867a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:43.731529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf37e4-3744-4bec-b377-5dbcec9d867a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:43.736150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee94296-8b08-4e76-8667-2d0825c5471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:43.736739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee94296-8b08-4e76-8667-2d0825c5471e admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.737016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee94296-8b08-4e76-8667-2d0825c5471e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.737286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee94296-8b08-4e76-8667-2d0825c5471e admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.737947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee94296-8b08-4e76-8667-2d0825c5471e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:43.739837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee94296-8b08-4e76-8667-2d0825c5471e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:43.767453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1260/2504] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:31:43 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:43.771735 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:43.782403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cad41-b91d-498c-8534-29f2baf1206d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:43.808268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:43.839638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbde2-3320-4313-8e4b-88b2020d0c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:43.840238 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbde2-3320-4313-8e4b-88b2020d0c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.840520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbde2-3320-4313-8e4b-88b2020d0c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.840793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efbde2-3320-4313-8e4b-88b2020d0c44 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.841424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efbde2-3320-4313-8e4b-88b2020d0c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:43.843939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efbde2-3320-4313-8e4b-88b2020d0c44 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:43.865169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1245/2505] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:31:43 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:31:43.869238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee94296-8b08-4e76-8667-2d0825c5471e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:43.879914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee94296-8b08-4e76-8667-2d0825c5471e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:43.884482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197ebb9-57a4-4f38-ae8f-e7f45445b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:43.885080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197ebb9-57a4-4f38-ae8f-e7f45445b587 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.885358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197ebb9-57a4-4f38-ae8f-e7f45445b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.885672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197ebb9-57a4-4f38-ae8f-e7f45445b587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.886312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197ebb9-57a4-4f38-ae8f-e7f45445b587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:43.888162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197ebb9-57a4-4f38-ae8f-e7f45445b587 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:43.898236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1261/2506] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:43.902021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbde2-3320-4313-8e4b-88b2020d0c44 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:43.912601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efbde2-3320-4313-8e4b-88b2020d0c44 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:43.917178 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e33dc8-7c11-4a98-94a5-06ea918eb7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:43.917803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e33dc8-7c11-4a98-94a5-06ea918eb7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.918090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e33dc8-7c11-4a98-94a5-06ea918eb7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.918369 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e33dc8-7c11-4a98-94a5-06ea918eb7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.919013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e33dc8-7c11-4a98-94a5-06ea918eb7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:43.921325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e33dc8-7c11-4a98-94a5-06ea918eb7c5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:43.931663 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1246/2507] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:31:43.935666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197ebb9-57a4-4f38-ae8f-e7f45445b587 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:43.946130 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197ebb9-57a4-4f38-ae8f-e7f45445b587 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:43.950861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfab2a-51fe-4453-8e73-a9274a8c7fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:43.952161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfab2a-51fe-4453-8e73-a9274a8c7fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.952373 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfab2a-51fe-4453-8e73-a9274a8c7fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.952736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfab2a-51fe-4453-8e73-a9274a8c7fe4 admin admin] PATH_INFO: `/v3/projects/57cf0e1868294cf2b358eb5ba29a6179/users/ef421ed07ed342a4af83c3a1e19fef45/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:43.967074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfab2a-51fe-4453-8e73-a9274a8c7fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cf0e1868294cf2b358eb5ba29a6179, user_id=ef421ed07ed342a4af83c3a1e19fef45, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:43.970070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfab2a-51fe-4453-8e73-a9274a8c7fe4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:43.983849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1262/2508] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:43 2022] PUT /identity/v3/projects/57cf0e1868294cf2b358eb5ba29a6179/users/ef421ed07ed342a4af83c3a1e19fef45/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:43.997811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff25c3-7bb4-44d4-bd9f-fab12b519bdc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:43.998107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff25c3-7bb4-44d4-bd9f-fab12b519bdc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:43.998965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff25c3-7bb4-44d4-bd9f-fab12b519bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.027198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-53ff25c3-7bb4-44d4-bd9f-fab12b519bdc None None] MFA Rules not processed for user `ef421ed07ed342a4af83c3a1e19fef45`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:44.028436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-53ff25c3-7bb4-44d4-bd9f-fab12b519bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:44.092825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1247/2509] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:44.097272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfab2a-51fe-4453-8e73-a9274a8c7fe4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:44.159557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfab2a-51fe-4453-8e73-a9274a8c7fe4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:44.164339 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243df87d-1351-46ca-bd1d-efafef00ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:44.164955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df87d-1351-46ca-bd1d-efafef00ab87 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:44.165239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df87d-1351-46ca-bd1d-efafef00ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:44.165515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df87d-1351-46ca-bd1d-efafef00ab87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.166187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243df87d-1351-46ca-bd1d-efafef00ab87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:44.168161 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243df87d-1351-46ca-bd1d-efafef00ab87 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:44.196218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1263/2510] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:31:44 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:44.200302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff25c3-7bb4-44d4-bd9f-fab12b519bdc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:44.210827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff25c3-7bb4-44d4-bd9f-fab12b519bdc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:44.266496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84627-befd-4003-84da-7ab2159ebffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:44.267183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84627-befd-4003-84da-7ab2159ebffb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:44.267679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84627-befd-4003-84da-7ab2159ebffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:44.267974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84627-befd-4003-84da-7ab2159ebffb admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.268604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f84627-befd-4003-84da-7ab2159ebffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:44.270542 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f84627-befd-4003-84da-7ab2159ebffb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:44.292325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1248/2511] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:31:44 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:44.297624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243df87d-1351-46ca-bd1d-efafef00ab87 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:44.307954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243df87d-1351-46ca-bd1d-efafef00ab87 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:44.313292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed8028-aac6-4b56-b979-9c3d39f2606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:44.313921 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8028-aac6-4b56-b979-9c3d39f2606b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:44.314200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8028-aac6-4b56-b979-9c3d39f2606b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:44.314471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8028-aac6-4b56-b979-9c3d39f2606b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.315108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed8028-aac6-4b56-b979-9c3d39f2606b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:44.316690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed8028-aac6-4b56-b979-9c3d39f2606b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:44.327542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1264/2512] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:44.331673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84627-befd-4003-84da-7ab2159ebffb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:44.341688 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84627-befd-4003-84da-7ab2159ebffb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:44.346618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5530a-0a18-4628-b752-2ce36ec5e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:44.347272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5530a-0a18-4628-b752-2ce36ec5e30b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:44.347556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5530a-0a18-4628-b752-2ce36ec5e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:44.347836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5530a-0a18-4628-b752-2ce36ec5e30b admin admin] PATH_INFO: `/v3/projects/873ef4a10f8044ef89f6d09702048ab7/users/be9e13009e8c42b2a7e5bf13d98bddc8/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.363140 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5530a-0a18-4628-b752-2ce36ec5e30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=873ef4a10f8044ef89f6d09702048ab7, user_id=be9e13009e8c42b2a7e5bf13d98bddc8, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:44.365879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5530a-0a18-4628-b752-2ce36ec5e30b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:44.379742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1249/2513] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:44 2022] PUT /identity/v3/projects/873ef4a10f8044ef89f6d09702048ab7/users/be9e13009e8c42b2a7e5bf13d98bddc8/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:31:44.383912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed8028-aac6-4b56-b979-9c3d39f2606b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:44.395084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed8028-aac6-4b56-b979-9c3d39f2606b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:44.417751 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:44.457301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e43607-4f72-4329-a74d-a98430d3f8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:44.457946 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e43607-4f72-4329-a74d-a98430d3f8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:44.458230 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e43607-4f72-4329-a74d-a98430d3f8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:44.458506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e43607-4f72-4329-a74d-a98430d3f8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.459176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e43607-4f72-4329-a74d-a98430d3f8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:44.460791 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e43607-4f72-4329-a74d-a98430d3f8a2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:44.471633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1265/2514] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:44.475810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5530a-0a18-4628-b752-2ce36ec5e30b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:44.481432 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:44.488802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5530a-0a18-4628-b752-2ce36ec5e30b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:44.493857 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:44.494528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:44.494810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:44.495085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] PATH_INFO: `/v3/projects/873ef4a10f8044ef89f6d09702048ab7/users/be9e13009e8c42b2a7e5bf13d98bddc8/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.496990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=873ef4a10f8044ef89f6d09702048ab7, user_id=be9e13009e8c42b2a7e5bf13d98bddc8, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:44.499786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:44.509741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1250/2515] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:44 2022] PUT /identity/v3/projects/873ef4a10f8044ef89f6d09702048ab7/users/be9e13009e8c42b2a7e5bf13d98bddc8/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:44.520348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0ca8-25c9-466b-a8cd-84ca4291cae8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:44.520633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0ca8-25c9-466b-a8cd-84ca4291cae8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:44.520907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0ca8-25c9-466b-a8cd-84ca4291cae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.549584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-646b0ca8-25c9-466b-a8cd-84ca4291cae8 None None] MFA Rules not processed for user `be9e13009e8c42b2a7e5bf13d98bddc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:44.550808 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-646b0ca8-25c9-466b-a8cd-84ca4291cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:44.622028 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1266/2516] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:44.634507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:44.636247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:44.695475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa56a-e257-4982-a719-01ffe5c3ba9e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:44.699164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01371c-ca0a-4d0d-97f4-80d5aa60e336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:44.699766 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01371c-ca0a-4d0d-97f4-80d5aa60e336 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:44.700048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01371c-ca0a-4d0d-97f4-80d5aa60e336 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:44.700328 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01371c-ca0a-4d0d-97f4-80d5aa60e336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:44.756670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01371c-ca0a-4d0d-97f4-80d5aa60e336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:44.758147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01371c-ca0a-4d0d-97f4-80d5aa60e336 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:44.767366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1251/2517] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:46.127167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b0ca8-25c9-466b-a8cd-84ca4291cae8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:46.128597 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-646b0ca8-25c9-466b-a8cd-84ca4291cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:46.141398 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b0ca8-25c9-466b-a8cd-84ca4291cae8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:46.145011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ae31e-5a60-468f-b037-2333018b8047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:46.145650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ae31e-5a60-468f-b037-2333018b8047 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:46.145932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ae31e-5a60-468f-b037-2333018b8047 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:46.146205 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ae31e-5a60-468f-b037-2333018b8047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:46.155762 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ae31e-5a60-468f-b037-2333018b8047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:46.157176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ae31e-5a60-468f-b037-2333018b8047 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:46.166562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1267/2518] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:31:49.975901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01371c-ca0a-4d0d-97f4-80d5aa60e336 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:50.040282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01371c-ca0a-4d0d-97f4-80d5aa60e336 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:50.044826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:50.045472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:50.045793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:50.046068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] PATH_INFO: `/v3/users/ef421ed07ed342a4af83c3a1e19fef45` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:50.047205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef421ed07ed342a4af83c3a1e19fef45)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:50.049946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:50.096934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:50.098879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef421ed07ed342a4af83c3a1e19fef45'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.099625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef421ed07ed342a4af83c3a1e19fef45'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.107650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef421ed07ed342a4af83c3a1e19fef45'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.120450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef421ed07ed342a4af83c3a1e19fef45'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.128070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef421ed07ed342a4af83c3a1e19fef45'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.133926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1252/2519] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:49 2022] DELETE /identity/v3/users/ef421ed07ed342a4af83c3a1e19fef45 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:50.139063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9cfdb-99ae-45c7-a338-ef54204ae45c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:50.139528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9cfdb-99ae-45c7-a338-ef54204ae45c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:50.139645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9cfdb-99ae-45c7-a338-ef54204ae45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:50.158606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-3bc9cfdb-99ae-45c7-a338-ef54204ae45c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:50.159798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3bc9cfdb-99ae-45c7-a338-ef54204ae45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:50.225805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1268/2520] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:50.236481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:50.237928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:50.311935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586b91-68b1-4af5-be1f-0890c2f7b67a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:50.317373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae6ea-c309-4b0d-96e9-e61d2b781503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:50.318021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae6ea-c309-4b0d-96e9-e61d2b781503 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:50.318329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae6ea-c309-4b0d-96e9-e61d2b781503 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:50.318601 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae6ea-c309-4b0d-96e9-e61d2b781503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:50.327996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedae6ea-c309-4b0d-96e9-e61d2b781503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:50.329983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedae6ea-c309-4b0d-96e9-e61d2b781503 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:50.339210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1253/2521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:31:50.632265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9cfdb-99ae-45c7-a338-ef54204ae45c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:50.633940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-3bc9cfdb-99ae-45c7-a338-ef54204ae45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:50.647152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9cfdb-99ae-45c7-a338-ef54204ae45c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:50.652067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:50.652801 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:50.660218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:50.660439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] PATH_INFO: `/v3/projects/57cf0e1868294cf2b358eb5ba29a6179` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:50.662878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cf0e1868294cf2b358eb5ba29a6179)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:50.667295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:50.701371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:50.724178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cf0e1868294cf2b358eb5ba29a6179', 'request_id': 'req-d097770f-0778-427e-b85e-d0894596e9ef'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.731001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cf0e1868294cf2b358eb5ba29a6179', 'request_id': 'req-d097770f-0778-427e-b85e-d0894596e9ef'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.737559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cf0e1868294cf2b358eb5ba29a6179', 'request_id': 'req-d097770f-0778-427e-b85e-d0894596e9ef'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.751108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] The token cache is being invalidate because project 57cf0e1868294cf2b358eb5ba29a6179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:50.751409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.752093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.756655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1269/2522] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:50 2022] DELETE /identity/v3/projects/57cf0e1868294cf2b358eb5ba29a6179 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:50.757765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae6ea-c309-4b0d-96e9-e61d2b781503 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:50.768116 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae6ea-c309-4b0d-96e9-e61d2b781503 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:50.826478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:50.827143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:50.827416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:50.827684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] PATH_INFO: `/v3/users/be9e13009e8c42b2a7e5bf13d98bddc8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:50.829482 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9e13009e8c42b2a7e5bf13d98bddc8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:50.831576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:50.883684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9e13009e8c42b2a7e5bf13d98bddc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.884412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9e13009e8c42b2a7e5bf13d98bddc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.900783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9e13009e8c42b2a7e5bf13d98bddc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.913586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:50.916700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9e13009e8c42b2a7e5bf13d98bddc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.929220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6d2933e-8e7e-4562-9795-a3096e4e6211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9e13009e8c42b2a7e5bf13d98bddc8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:50.940076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1254/2523] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:50 2022] DELETE /identity/v3/users/be9e13009e8c42b2a7e5bf13d98bddc8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:51.233217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:51.235128 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:51.250004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097770f-0778-427e-b85e-d0894596e9ef admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:51.312709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:51.314501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.314794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.315074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] PATH_INFO: `/v3/projects/873ef4a10f8044ef89f6d09702048ab7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.316209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873ef4a10f8044ef89f6d09702048ab7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:51.318169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:51.364334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873ef4a10f8044ef89f6d09702048ab7', 'request_id': 'req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:51.370494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873ef4a10f8044ef89f6d09702048ab7', 'request_id': 'req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:51.376633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873ef4a10f8044ef89f6d09702048ab7', 'request_id': 'req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:51.392533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] The token cache is being invalidate because project 873ef4a10f8044ef89f6d09702048ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:51.392822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:51.393457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-d8b7c0b7-38aa-47e1-99c6-ca13f2b64182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:51.394972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1270/2524] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:51 2022] DELETE /identity/v3/projects/873ef4a10f8044ef89f6d09702048ab7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:51.399985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a5299-5d6c-4394-b01b-8fce4fea923c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.400486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a5299-5d6c-4394-b01b-8fce4fea923c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.400590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a5299-5d6c-4394-b01b-8fce4fea923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.420136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3a2a5299-5d6c-4394-b01b-8fce4fea923c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:51.421350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a2a5299-5d6c-4394-b01b-8fce4fea923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:51.479275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1255/2525] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:51.488366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547a44-2c82-4690-b310-cab4c3f13701 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.488587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547a44-2c82-4690-b310-cab4c3f13701 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.488865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547a44-2c82-4690-b310-cab4c3f13701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.509557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-76547a44-2c82-4690-b310-cab4c3f13701 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:51.510800 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-76547a44-2c82-4690-b310-cab4c3f13701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:51.519805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1271/2526] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:51.524160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a5299-5d6c-4394-b01b-8fce4fea923c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:51.534431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a5299-5d6c-4394-b01b-8fce4fea923c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:51.539811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:51.540418 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.540702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.540975 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.541657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:31:51.541967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:51.543554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:51.557377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1256/2527] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:31:51.561764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76547a44-2c82-4690-b310-cab4c3f13701 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:51.571912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76547a44-2c82-4690-b310-cab4c3f13701 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:51.576627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d875-84c9-457d-abbd-7f320aaa7988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:51.577251 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d875-84c9-457d-abbd-7f320aaa7988 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.577525 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d875-84c9-457d-abbd-7f320aaa7988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.577821 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d875-84c9-457d-abbd-7f320aaa7988 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.578454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0d875-84c9-457d-abbd-7f320aaa7988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:51.580440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0d875-84c9-457d-abbd-7f320aaa7988 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:51.607603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1272/2528] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:31:51 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:31:51.612425 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:51.622316 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a3b7e-3b47-4530-977c-479df0b044e1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:51.678064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fab64-a5bf-4ed6-ac23-de32bd00b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:51.678679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fab64-a5bf-4ed6-ac23-de32bd00b1de admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.678964 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fab64-a5bf-4ed6-ac23-de32bd00b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.679237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fab64-a5bf-4ed6-ac23-de32bd00b1de admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.679869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fab64-a5bf-4ed6-ac23-de32bd00b1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:51.681822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fab64-a5bf-4ed6-ac23-de32bd00b1de admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:51.713391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1257/2529] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:31:51 2022] POST /identity/v3/users => generated 305 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:51.717572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d875-84c9-457d-abbd-7f320aaa7988 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:51.728384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d875-84c9-457d-abbd-7f320aaa7988 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:51.733274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbd0f2-b326-4f0e-85b6-f82950653c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:51.733916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbd0f2-b326-4f0e-85b6-f82950653c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.734605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbd0f2-b326-4f0e-85b6-f82950653c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.734605 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbd0f2-b326-4f0e-85b6-f82950653c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.735666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbd0f2-b326-4f0e-85b6-f82950653c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:51.737286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbd0f2-b326-4f0e-85b6-f82950653c23 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:51.748810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1273/2530] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:51.753848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fab64-a5bf-4ed6-ac23-de32bd00b1de admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:51.765351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fab64-a5bf-4ed6-ac23-de32bd00b1de admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:51.770599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34976893-5c94-4d12-b87a-3ef51091d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:51.771203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976893-5c94-4d12-b87a-3ef51091d598 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.771486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976893-5c94-4d12-b87a-3ef51091d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.771761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976893-5c94-4d12-b87a-3ef51091d598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.772412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34976893-5c94-4d12-b87a-3ef51091d598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:51.774041 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34976893-5c94-4d12-b87a-3ef51091d598 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:51.785122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1258/2531] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:51.789671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbd0f2-b326-4f0e-85b6-f82950653c23 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:51.801202 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbd0f2-b326-4f0e-85b6-f82950653c23 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:51.805934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98852-ee6b-419f-90f3-b7199bcb96e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:51.806612 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98852-ee6b-419f-90f3-b7199bcb96e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.806896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98852-ee6b-419f-90f3-b7199bcb96e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.807191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98852-ee6b-419f-90f3-b7199bcb96e1 admin admin] PATH_INFO: `/v3/projects/e0118ba9bf4f470faff441b8cbe4fdd7/users/1b61e812bfe24bb3965f56a4160a02c6/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.809811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:51.829573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98852-ee6b-419f-90f3-b7199bcb96e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0118ba9bf4f470faff441b8cbe4fdd7, user_id=1b61e812bfe24bb3965f56a4160a02c6, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:51.832349 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98852-ee6b-419f-90f3-b7199bcb96e1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:51.846889 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1274/2532] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:51 2022] PUT /identity/v3/projects/e0118ba9bf4f470faff441b8cbe4fdd7/users/1b61e812bfe24bb3965f56a4160a02c6/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:31:51.857244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f8af-64a8-449f-9928-d053f6c79421 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:51.857544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f8af-64a8-449f-9928-d053f6c79421 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:51.857855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f8af-64a8-449f-9928-d053f6c79421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:51.886130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f402f8af-64a8-449f-9928-d053f6c79421 None None] MFA Rules not processed for user `1b61e812bfe24bb3965f56a4160a02c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:51.887339 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f402f8af-64a8-449f-9928-d053f6c79421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:51.928949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:51.961785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1259/2533] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:51.966232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98852-ee6b-419f-90f3-b7199bcb96e1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:52.026838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98852-ee6b-419f-90f3-b7199bcb96e1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:52.031470 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d50e9-412b-442f-a669-005bafd50c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:52.032632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d50e9-412b-442f-a669-005bafd50c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.033292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d50e9-412b-442f-a669-005bafd50c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.033292 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d50e9-412b-442f-a669-005bafd50c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.033901 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d50e9-412b-442f-a669-005bafd50c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:52.035803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d50e9-412b-442f-a669-005bafd50c5b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:52.064268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1275/2534] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:31:51 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:52.068310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402f8af-64a8-449f-9928-d053f6c79421 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:52.079301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402f8af-64a8-449f-9928-d053f6c79421 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:52.138452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7adca-479a-4191-8279-54204b07e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:52.139176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7adca-479a-4191-8279-54204b07e07b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.139506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7adca-479a-4191-8279-54204b07e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.139793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7adca-479a-4191-8279-54204b07e07b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.140366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7adca-479a-4191-8279-54204b07e07b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:52.142446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7adca-479a-4191-8279-54204b07e07b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:52.168657 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1260/2535] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:31:52 2022] POST /identity/v3/users => generated 311 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:52.169978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d50e9-412b-442f-a669-005bafd50c5b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:52.181789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d50e9-412b-442f-a669-005bafd50c5b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:52.187290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9dd22-f9c0-424e-9239-97109640c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:52.188055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9dd22-f9c0-424e-9239-97109640c599 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.188410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9dd22-f9c0-424e-9239-97109640c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.188872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9dd22-f9c0-424e-9239-97109640c599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.189735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9dd22-f9c0-424e-9239-97109640c599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:52.191604 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9dd22-f9c0-424e-9239-97109640c599 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:52.203189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1276/2536] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:52.207427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7adca-479a-4191-8279-54204b07e07b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:52.217999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7adca-479a-4191-8279-54204b07e07b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:52.223905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d03d3-85b4-4019-a8c7-3ca005da047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:52.224574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d03d3-85b4-4019-a8c7-3ca005da047b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.224856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d03d3-85b4-4019-a8c7-3ca005da047b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.225290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d03d3-85b4-4019-a8c7-3ca005da047b admin admin] PATH_INFO: `/v3/projects/fe2fcd793261426faaa210ab5259a1d8/users/29299e1040274e89bd485cbd63ea5e27/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.250068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d03d3-85b4-4019-a8c7-3ca005da047b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2fcd793261426faaa210ab5259a1d8, user_id=29299e1040274e89bd485cbd63ea5e27, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:52.255517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d03d3-85b4-4019-a8c7-3ca005da047b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:52.274637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1261/2537] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:52 2022] PUT /identity/v3/projects/fe2fcd793261426faaa210ab5259a1d8/users/29299e1040274e89bd485cbd63ea5e27/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:52.279380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9dd22-f9c0-424e-9239-97109640c599 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:52.296382 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9dd22-f9c0-424e-9239-97109640c599 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:52.359330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc832f4f-46fc-41fb-9595-d1b542b45b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:52.359938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc832f4f-46fc-41fb-9595-d1b542b45b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.360222 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc832f4f-46fc-41fb-9595-d1b542b45b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.360494 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc832f4f-46fc-41fb-9595-d1b542b45b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.361243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc832f4f-46fc-41fb-9595-d1b542b45b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:52.362888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc832f4f-46fc-41fb-9595-d1b542b45b53 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:52.372806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1277/2538] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:52.377141 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d03d3-85b4-4019-a8c7-3ca005da047b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:52.387896 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d03d3-85b4-4019-a8c7-3ca005da047b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:52.394221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:52.394912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.395194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.395467 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] PATH_INFO: `/v3/projects/fe2fcd793261426faaa210ab5259a1d8/users/29299e1040274e89bd485cbd63ea5e27/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.397372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2fcd793261426faaa210ab5259a1d8, user_id=29299e1040274e89bd485cbd63ea5e27, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:52.400103 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:52.411603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1262/2539] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:31:52 2022] PUT /identity/v3/projects/fe2fcd793261426faaa210ab5259a1d8/users/29299e1040274e89bd485cbd63ea5e27/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:31:52.421768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa53fd6-2c33-4745-ab5b-61351e7c7cd8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.422056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa53fd6-2c33-4745-ab5b-61351e7c7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.422337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa53fd6-2c33-4745-ab5b-61351e7c7cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.450004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5aa53fd6-2c33-4745-ab5b-61351e7c7cd8 None None] MFA Rules not processed for user `29299e1040274e89bd485cbd63ea5e27`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:52.451219 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5aa53fd6-2c33-4745-ab5b-61351e7c7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:52.493179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:52.521504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1278/2540] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:52 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:52.532125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:52.534286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:52.596029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa8059-5d4a-4213-8cb4-02531e7cf37a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:52.599839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67069d8-0a43-41b8-b659-56b63474e869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:52.600471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67069d8-0a43-41b8-b659-56b63474e869 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.600754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67069d8-0a43-41b8-b659-56b63474e869 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.601031 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67069d8-0a43-41b8-b659-56b63474e869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.611706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67069d8-0a43-41b8-b659-56b63474e869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:52.613442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67069d8-0a43-41b8-b659-56b63474e869 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:52.623471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1263/2541] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:52 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:52.781462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa53fd6-2c33-4745-ab5b-61351e7c7cd8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:52.791994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa53fd6-2c33-4745-ab5b-61351e7c7cd8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:52.795546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708943fa-b956-445b-9f20-b9ab6eccf16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:52.796147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708943fa-b956-445b-9f20-b9ab6eccf16e service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:52.796448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708943fa-b956-445b-9f20-b9ab6eccf16e service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:52.796703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708943fa-b956-445b-9f20-b9ab6eccf16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:52.857961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708943fa-b956-445b-9f20-b9ab6eccf16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:52.859407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708943fa-b956-445b-9f20-b9ab6eccf16e service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:52.869432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1279/2542] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:58.176507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67069d8-0a43-41b8-b659-56b63474e869 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:58.215718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:58.240978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67069d8-0a43-41b8-b659-56b63474e869 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:58.247022 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:58.247679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:58.247965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:58.248338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] PATH_INFO: `/v3/users/1b61e812bfe24bb3965f56a4160a02c6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:58.249647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b61e812bfe24bb3965f56a4160a02c6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:58.251668 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:58.303706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b61e812bfe24bb3965f56a4160a02c6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.304492 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b61e812bfe24bb3965f56a4160a02c6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.312998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b61e812bfe24bb3965f56a4160a02c6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.337681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b61e812bfe24bb3965f56a4160a02c6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.351919 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b61e812bfe24bb3965f56a4160a02c6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.369941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1264/2543] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:58 2022] DELETE /identity/v3/users/1b61e812bfe24bb3965f56a4160a02c6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:58.371658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1746f-c6c4-480a-afed-bac1601cb4e8 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:58.372155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1746f-c6c4-480a-afed-bac1601cb4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:58.372383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1746f-c6c4-480a-afed-bac1601cb4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:58.399915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-49b1746f-c6c4-480a-afed-bac1601cb4e8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:58.403451 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-49b1746f-c6c4-480a-afed-bac1601cb4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:58.488509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1280/2544] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:58.498795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:58.500289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:58.565861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2626-36bc-4046-97ea-fff355b38b3b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:58.569846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d0d9c-99dc-43b8-ae6e-89b8f561d11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:58.570472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d0d9c-99dc-43b8-ae6e-89b8f561d11a service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:58.570777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d0d9c-99dc-43b8-ae6e-89b8f561d11a service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:58.571062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d0d9c-99dc-43b8-ae6e-89b8f561d11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:58.581248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d0d9c-99dc-43b8-ae6e-89b8f561d11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:58.582729 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d0d9c-99dc-43b8-ae6e-89b8f561d11a service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:58.592966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1265/2545] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:31:58.876319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1746f-c6c4-480a-afed-bac1601cb4e8 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:58.878021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-49b1746f-c6c4-480a-afed-bac1601cb4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:58.894094 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1746f-c6c4-480a-afed-bac1601cb4e8 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:58.900096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:58.900537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:58.900819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:58.901113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] PATH_INFO: `/v3/projects/e0118ba9bf4f470faff441b8cbe4fdd7` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:58.902213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0118ba9bf4f470faff441b8cbe4fdd7)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:58.904123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:58.951334 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0118ba9bf4f470faff441b8cbe4fdd7', 'request_id': 'req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.957593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0118ba9bf4f470faff441b8cbe4fdd7', 'request_id': 'req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.963185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0118ba9bf4f470faff441b8cbe4fdd7', 'request_id': 'req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.972741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:58.977354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] The token cache is being invalidate because project e0118ba9bf4f470faff441b8cbe4fdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:58.977882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.978983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:58.980662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1281/2546] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:58 2022] DELETE /identity/v3/projects/e0118ba9bf4f470faff441b8cbe4fdd7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:58.984626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d0d9c-99dc-43b8-ae6e-89b8f561d11a service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:58.997452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d0d9c-99dc-43b8-ae6e-89b8f561d11a service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:59.048801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:59.057129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:59.058115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.058574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.059121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] PATH_INFO: `/v3/users/29299e1040274e89bd485cbd63ea5e27` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.060509 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29299e1040274e89bd485cbd63ea5e27)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:59.062478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:59.109439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29299e1040274e89bd485cbd63ea5e27'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.110117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29299e1040274e89bd485cbd63ea5e27'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.120368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29299e1040274e89bd485cbd63ea5e27'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.132973 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29299e1040274e89bd485cbd63ea5e27'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.140541 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-345e1285-b1a5-4557-8bbe-87855d5b8a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29299e1040274e89bd485cbd63ea5e27'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.147177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1266/2547] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:31:58 2022] DELETE /identity/v3/users/29299e1040274e89bd485cbd63ea5e27 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:59.433013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:59.434830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:59.449591 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d295e-0e3e-4e13-adcd-bb9d8d9b9659 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:59.510129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:59.510129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.510129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.510129 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] PATH_INFO: `/v3/projects/fe2fcd793261426faaa210ab5259a1d8` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.513572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2fcd793261426faaa210ab5259a1d8)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:59.514964 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:59.570722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2fcd793261426faaa210ab5259a1d8', 'request_id': 'req-ecf36478-3f96-4050-ac39-30932b43ecd8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.577766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2fcd793261426faaa210ab5259a1d8', 'request_id': 'req-ecf36478-3f96-4050-ac39-30932b43ecd8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.584055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2fcd793261426faaa210ab5259a1d8', 'request_id': 'req-ecf36478-3f96-4050-ac39-30932b43ecd8'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.597908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] The token cache is being invalidate because project fe2fcd793261426faaa210ab5259a1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:31:59.598489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.599122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ecf36478-3f96-4050-ac39-30932b43ecd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:31:59.600806 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1282/2548] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:31:59 2022] DELETE /identity/v3/projects/fe2fcd793261426faaa210ab5259a1d8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:31:59.605653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403d0df-693f-45b0-a365-01d5bdea1586 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.606152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403d0df-693f-45b0-a365-01d5bdea1586 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.606364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403d0df-693f-45b0-a365-01d5bdea1586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.626389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3403d0df-693f-45b0-a365-01d5bdea1586 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:59.628428 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3403d0df-693f-45b0-a365-01d5bdea1586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:59.692557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1267/2549] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:31:59.701589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24588679-ed71-48e6-a07e-ddbc12b14094 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.701886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24588679-ed71-48e6-a07e-ddbc12b14094 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.702168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24588679-ed71-48e6-a07e-ddbc12b14094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.725442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-24588679-ed71-48e6-a07e-ddbc12b14094 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:31:59.726777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-24588679-ed71-48e6-a07e-ddbc12b14094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:31:59.734816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1283/2550] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:31:59.739693 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403d0df-693f-45b0-a365-01d5bdea1586 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:59.749204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403d0df-693f-45b0-a365-01d5bdea1586 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:59.753996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:59.754605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.754890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.755166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.755827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:31:59.756132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:59.757821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:59.769933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1268/2551] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:31:59.774345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24588679-ed71-48e6-a07e-ddbc12b14094 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:59.784517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24588679-ed71-48e6-a07e-ddbc12b14094 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:59.789476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b7262-9e1f-4c8f-a142-ca3c961854bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:59.790190 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b7262-9e1f-4c8f-a142-ca3c961854bd admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.790566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b7262-9e1f-4c8f-a142-ca3c961854bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.790845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b7262-9e1f-4c8f-a142-ca3c961854bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.791486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b7262-9e1f-4c8f-a142-ca3c961854bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:59.793414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b7262-9e1f-4c8f-a142-ca3c961854bd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:59.821618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1284/2552] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:31:59 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:59.826175 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:59.836922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456627a-77bf-45ab-b1d1-02168c068ed0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:59.895880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5cebe-67c2-4f52-aa32-6b511ae61025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:59.896501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cebe-67c2-4f52-aa32-6b511ae61025 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.896787 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cebe-67c2-4f52-aa32-6b511ae61025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.897064 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cebe-67c2-4f52-aa32-6b511ae61025 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.897742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5cebe-67c2-4f52-aa32-6b511ae61025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:59.899699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5cebe-67c2-4f52-aa32-6b511ae61025 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:59.910678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:31:59.927248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1269/2553] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:31:59 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:31:59.928587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b7262-9e1f-4c8f-a142-ca3c961854bd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:59.939169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b7262-9e1f-4c8f-a142-ca3c961854bd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:59.943959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc116e-2c39-4438-bc39-a560bd3a96fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:59.944559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc116e-2c39-4438-bc39-a560bd3a96fd admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.944835 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc116e-2c39-4438-bc39-a560bd3a96fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.945110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc116e-2c39-4438-bc39-a560bd3a96fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.945822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc116e-2c39-4438-bc39-a560bd3a96fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:59.947402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc116e-2c39-4438-bc39-a560bd3a96fd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:59.959072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1285/2554] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:31:59.963181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5cebe-67c2-4f52-aa32-6b511ae61025 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:31:59.975489 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5cebe-67c2-4f52-aa32-6b511ae61025 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:31:59.982296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065584-6b49-4141-933b-abeb1d5dbf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:31:59.982912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065584-6b49-4141-933b-abeb1d5dbf06 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:31:59.983202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065584-6b49-4141-933b-abeb1d5dbf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:31:59.983476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065584-6b49-4141-933b-abeb1d5dbf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:31:59.984134 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065584-6b49-4141-933b-abeb1d5dbf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:31:59.985791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065584-6b49-4141-933b-abeb1d5dbf06 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:31:59.997355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1270/2555] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:32:00.001704 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc116e-2c39-4438-bc39-a560bd3a96fd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:00.012541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc116e-2c39-4438-bc39-a560bd3a96fd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:00.017609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:00.018809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:00.019213 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:00.019488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] PATH_INFO: `/v3/projects/1c1a529d416f42a4803b8ce335121721/users/c27c5e7705054b6797c8e34185a62bf2/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:00.035813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1a529d416f42a4803b8ce335121721, user_id=c27c5e7705054b6797c8e34185a62bf2, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:00.038685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:00.051882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1286/2556] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:00 2022] PUT /identity/v3/projects/1c1a529d416f42a4803b8ce335121721/users/c27c5e7705054b6797c8e34185a62bf2/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:00.063215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534a7d-9570-4909-b5fe-63442fa26ef7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:00.063590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534a7d-9570-4909-b5fe-63442fa26ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:00.063936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6534a7d-9570-4909-b5fe-63442fa26ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:00.101648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f6534a7d-9570-4909-b5fe-63442fa26ef7 None None] MFA Rules not processed for user `c27c5e7705054b6797c8e34185a62bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:00.102892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6534a7d-9570-4909-b5fe-63442fa26ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:00.177244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1271/2557] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:00.188841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:00.191299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:00.225888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:00.258192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97578e-cae9-4b46-ae5b-89fda38703de admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:00.261884 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75391a3-6c0d-4f38-aae4-bb99291d2c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:00.262504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75391a3-6c0d-4f38-aae4-bb99291d2c67 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:00.262783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75391a3-6c0d-4f38-aae4-bb99291d2c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:00.263265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75391a3-6c0d-4f38-aae4-bb99291d2c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:00.273916 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75391a3-6c0d-4f38-aae4-bb99291d2c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:00.275790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75391a3-6c0d-4f38-aae4-bb99291d2c67 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:00.287150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1287/2558] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:32:00.313203 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6534a7d-9570-4909-b5fe-63442fa26ef7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:00.390798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6534a7d-9570-4909-b5fe-63442fa26ef7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:00.397103 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:00.398160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:00.398816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:00.398816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] PATH_INFO: `/v3/users/c27c5e7705054b6797c8e34185a62bf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:00.400706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27c5e7705054b6797c8e34185a62bf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:00.403535 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:00.455904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27c5e7705054b6797c8e34185a62bf2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:00.457948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27c5e7705054b6797c8e34185a62bf2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:00.468690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27c5e7705054b6797c8e34185a62bf2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:00.484551 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27c5e7705054b6797c8e34185a62bf2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:00.486533 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:00.494087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27c5e7705054b6797c8e34185a62bf2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:00.504520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1272/2559] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:00 2022] DELETE /identity/v3/users/c27c5e7705054b6797c8e34185a62bf2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:00.521770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0191-23df-4157-a60c-38039f030d0f None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:00.521770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0191-23df-4157-a60c-38039f030d0f None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:00.521770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0191-23df-4157-a60c-38039f030d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:00.530108 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c0be0191-23df-4157-a60c-38039f030d0f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:00.531307 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c0be0191-23df-4157-a60c-38039f030d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:00.592220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1288/2560] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:00.603127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:00.604561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:00.666282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825bc0b-07fd-4815-af99-657a2adb3a2a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:00.670056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f8ce9-2853-44f5-a693-55c9168b8d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:00.670672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f8ce9-2853-44f5-a693-55c9168b8d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:00.670959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f8ce9-2853-44f5-a693-55c9168b8d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:00.671242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f8ce9-2853-44f5-a693-55c9168b8d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:00.682274 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f8ce9-2853-44f5-a693-55c9168b8d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:00.683730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f8ce9-2853-44f5-a693-55c9168b8d90 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:00.694496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1273/2561] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:01.012678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be0191-23df-4157-a60c-38039f030d0f None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.014156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c0be0191-23df-4157-a60c-38039f030d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:01.027332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be0191-23df-4157-a60c-38039f030d0f None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.032220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.032866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.033146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.033417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] PATH_INFO: `/v3/projects/1c1a529d416f42a4803b8ce335121721` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.035113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1a529d416f42a4803b8ce335121721)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.037150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:01.092255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1a529d416f42a4803b8ce335121721', 'request_id': 'req-37faec41-bcc2-44de-8d07-069ad6338a77'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:01.100085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1a529d416f42a4803b8ce335121721', 'request_id': 'req-37faec41-bcc2-44de-8d07-069ad6338a77'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:01.105989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1a529d416f42a4803b8ce335121721', 'request_id': 'req-37faec41-bcc2-44de-8d07-069ad6338a77'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:01.119614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] The token cache is being invalidate because project 1c1a529d416f42a4803b8ce335121721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:01.119902 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:01.120518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-37faec41-bcc2-44de-8d07-069ad6338a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:01.122097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1289/2562] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:01 2022] DELETE /identity/v3/projects/1c1a529d416f42a4803b8ce335121721 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:01.127272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60517-3f00-4435-82a6-5bf3a9fcab10 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.127605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60517-3f00-4435-82a6-5bf3a9fcab10 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.127877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60517-3f00-4435-82a6-5bf3a9fcab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.147930 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-44a60517-3f00-4435-82a6-5bf3a9fcab10 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:01.149151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-44a60517-3f00-4435-82a6-5bf3a9fcab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:01.208570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1274/2563] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:01.216255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6a8f-68df-41eb-ba7e-3536ac6e9ac5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.216548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6a8f-68df-41eb-ba7e-3536ac6e9ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.216818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6a8f-68df-41eb-ba7e-3536ac6e9ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.238618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-eb3d6a8f-68df-41eb-ba7e-3536ac6e9ac5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:01.239830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-eb3d6a8f-68df-41eb-ba7e-3536ac6e9ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:01.248765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1290/2564] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:01.253307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60517-3f00-4435-82a6-5bf3a9fcab10 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.263105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60517-3f00-4435-82a6-5bf3a9fcab10 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.267852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.268454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.268739 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.269015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.269709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:01.270017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.271613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:01.283367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1275/2565] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:32:01.288245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d6a8f-68df-41eb-ba7e-3536ac6e9ac5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.297752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d6a8f-68df-41eb-ba7e-3536ac6e9ac5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.303215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005f465-08d8-4bc4-a6c3-496d900d61fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.303804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005f465-08d8-4bc4-a6c3-496d900d61fa admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.304079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005f465-08d8-4bc4-a6c3-496d900d61fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.304344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005f465-08d8-4bc4-a6c3-496d900d61fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.305012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005f465-08d8-4bc4-a6c3-496d900d61fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.306983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005f465-08d8-4bc4-a6c3-496d900d61fa admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:01.338573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1291/2566] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:01 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:01.339685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.350512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7dcd7-d5fb-4a5f-abb9-715be584b588 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.410585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f759525-fe1b-4239-a06b-64f6e8267f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.411187 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f759525-fe1b-4239-a06b-64f6e8267f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.411470 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f759525-fe1b-4239-a06b-64f6e8267f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.411752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f759525-fe1b-4239-a06b-64f6e8267f52 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.412381 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f759525-fe1b-4239-a06b-64f6e8267f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.414314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f759525-fe1b-4239-a06b-64f6e8267f52 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:01.435440 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1276/2567] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:01 2022] POST /identity/v3/users => generated 280 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:01.439571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005f465-08d8-4bc4-a6c3-496d900d61fa admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.450068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005f465-08d8-4bc4-a6c3-496d900d61fa admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.454780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19e3c-ad00-4925-a719-97071ebcf4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.455378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19e3c-ad00-4925-a719-97071ebcf4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.456293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19e3c-ad00-4925-a719-97071ebcf4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.456572 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19e3c-ad00-4925-a719-97071ebcf4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.457309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b19e3c-ad00-4925-a719-97071ebcf4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.458958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b19e3c-ad00-4925-a719-97071ebcf4dc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:01.469012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1292/2568] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:01.473865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f759525-fe1b-4239-a06b-64f6e8267f52 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.483827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f759525-fe1b-4239-a06b-64f6e8267f52 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.488548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acd5b8-43f3-4ec7-a43f-4c2fb2f80484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.489139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acd5b8-43f3-4ec7-a43f-4c2fb2f80484 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.489421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acd5b8-43f3-4ec7-a43f-4c2fb2f80484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.489734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acd5b8-43f3-4ec7-a43f-4c2fb2f80484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.490384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acd5b8-43f3-4ec7-a43f-4c2fb2f80484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.492029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acd5b8-43f3-4ec7-a43f-4c2fb2f80484 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:01.497331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:01.506640 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1277/2569] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:01.507519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19e3c-ad00-4925-a719-97071ebcf4dc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.518574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19e3c-ad00-4925-a719-97071ebcf4dc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.523256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.523925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.524237 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.524515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] PATH_INFO: `/v3/projects/570391ad35124bacae194ec64d45719f/users/b33ed2d5d2664ae2a6cfdcdd16ff74e8/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.537063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:01.542221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570391ad35124bacae194ec64d45719f, user_id=b33ed2d5d2664ae2a6cfdcdd16ff74e8, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.545574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:01.562138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1293/2570] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:01 2022] PUT /identity/v3/projects/570391ad35124bacae194ec64d45719f/users/b33ed2d5d2664ae2a6cfdcdd16ff74e8/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:01.574649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7965-1f17-4912-8402-1a18650cd380 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.574649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7965-1f17-4912-8402-1a18650cd380 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.574649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7965-1f17-4912-8402-1a18650cd380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.612152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-21dc7965-1f17-4912-8402-1a18650cd380 None None] MFA Rules not processed for user `b33ed2d5d2664ae2a6cfdcdd16ff74e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:01.615773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-21dc7965-1f17-4912-8402-1a18650cd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:01.719297 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1278/2571] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:01.756959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.761829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:01.827844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b276cf-9509-4c3e-bc23-3ad3ea9e53c0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.833430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8a7c4-4cc3-4cbe-82d5-a850a1e193ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.834081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a7c4-4cc3-4cbe-82d5-a850a1e193ad service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.834359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a7c4-4cc3-4cbe-82d5-a850a1e193ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.834631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8a7c4-4cc3-4cbe-82d5-a850a1e193ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.844861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8a7c4-4cc3-4cbe-82d5-a850a1e193ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.847206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8a7c4-4cc3-4cbe-82d5-a850a1e193ad service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:01.857217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1294/2572] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:01.874810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc7965-1f17-4912-8402-1a18650cd380 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:01.943484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc7965-1f17-4912-8402-1a18650cd380 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:01.948249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:01.948909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:01.949177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:01.949456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] PATH_INFO: `/v3/users/b33ed2d5d2664ae2a6cfdcdd16ff74e8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:01.950647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33ed2d5d2664ae2a6cfdcdd16ff74e8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:01.952577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:02.006666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33ed2d5d2664ae2a6cfdcdd16ff74e8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:02.007329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33ed2d5d2664ae2a6cfdcdd16ff74e8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:02.014826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33ed2d5d2664ae2a6cfdcdd16ff74e8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:02.028965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33ed2d5d2664ae2a6cfdcdd16ff74e8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:02.035961 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33ed2d5d2664ae2a6cfdcdd16ff74e8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:02.041854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1279/2573] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:01 2022] DELETE /identity/v3/users/b33ed2d5d2664ae2a6cfdcdd16ff74e8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:02.046432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4561f84-a3d2-4c61-bf4c-e570213ec90d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:02.046742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4561f84-a3d2-4c61-bf4c-e570213ec90d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:02.046996 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4561f84-a3d2-4c61-bf4c-e570213ec90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:02.068106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a4561f84-a3d2-4c61-bf4c-e570213ec90d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:02.069474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a4561f84-a3d2-4c61-bf4c-e570213ec90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:02.133871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1295/2574] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:02.144118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:02.145825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:02.156895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:02.240623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3ce6-35a3-468d-8606-524e98e23636 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:02.247008 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04473991-cd33-4f71-b251-8912cc583629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:02.248063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04473991-cd33-4f71-b251-8912cc583629 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:02.248367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04473991-cd33-4f71-b251-8912cc583629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:02.248647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04473991-cd33-4f71-b251-8912cc583629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:02.269615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04473991-cd33-4f71-b251-8912cc583629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:02.271214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04473991-cd33-4f71-b251-8912cc583629 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:02.283587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1280/2575] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:03.284719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4561f84-a3d2-4c61-bf4c-e570213ec90d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:03.287376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a4561f84-a3d2-4c61-bf4c-e570213ec90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:03.316887 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4561f84-a3d2-4c61-bf4c-e570213ec90d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:03.326197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:03.327135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:03.327620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:03.327953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] PATH_INFO: `/v3/projects/570391ad35124bacae194ec64d45719f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:03.329406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] RBAC: Authorizing `identity:delete_project(project_id=570391ad35124bacae194ec64d45719f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:03.331900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:03.396384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570391ad35124bacae194ec64d45719f', 'request_id': 'req-4979ca65-a461-4681-abb2-7b47754e408a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:03.403546 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570391ad35124bacae194ec64d45719f', 'request_id': 'req-4979ca65-a461-4681-abb2-7b47754e408a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:03.410137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570391ad35124bacae194ec64d45719f', 'request_id': 'req-4979ca65-a461-4681-abb2-7b47754e408a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:03.423191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] The token cache is being invalidate because project 570391ad35124bacae194ec64d45719f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:03.423479 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:03.424119 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4979ca65-a461-4681-abb2-7b47754e408a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:03.426280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1296/2576] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:03 2022] DELETE /identity/v3/projects/570391ad35124bacae194ec64d45719f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:03.431173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc929-a821-4ece-89b7-916375e3fe27 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:03.431704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc929-a821-4ece-89b7-916375e3fe27 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:03.431947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc929-a821-4ece-89b7-916375e3fe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:03.454711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-926cc929-a821-4ece-89b7-916375e3fe27 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:03.456062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-926cc929-a821-4ece-89b7-916375e3fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:03.655913 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1281/2577] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:03.664062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5a7-b0b4-4c2a-b577-94234a84007d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:03.664341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5a7-b0b4-4c2a-b577-94234a84007d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:03.664822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5a7-b0b4-4c2a-b577-94234a84007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:03.690078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-0857f5a7-b0b4-4c2a-b577-94234a84007d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:03.691568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-0857f5a7-b0b4-4c2a-b577-94234a84007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:03.701116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1297/2578] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:03.705414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc929-a821-4ece-89b7-916375e3fe27 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:03.716460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc929-a821-4ece-89b7-916375e3fe27 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:03.726290 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:03.727269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:03.727907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:03.728486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:03.729404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:03.731127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:03.733151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:03.755614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1282/2579] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:03.762326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f5a7-b0b4-4c2a-b577-94234a84007d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:03.776675 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f5a7-b0b4-4c2a-b577-94234a84007d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:03.785178 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069874cf-b703-487d-a28e-b3aba064dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:03.786388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069874cf-b703-487d-a28e-b3aba064dca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:03.787031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069874cf-b703-487d-a28e-b3aba064dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:03.787374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069874cf-b703-487d-a28e-b3aba064dca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:03.788197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069874cf-b703-487d-a28e-b3aba064dca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:03.790424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069874cf-b703-487d-a28e-b3aba064dca1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:03.797709 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:03.836794 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1298/2580] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:03 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:03.840836 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:03.852534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427eee2-b72d-46a9-af75-1b877b906feb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:03.939063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93885e-f0ef-475a-9192-8c97b54a7ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:03.939684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93885e-f0ef-475a-9192-8c97b54a7ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:03.939970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93885e-f0ef-475a-9192-8c97b54a7ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:03.940253 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93885e-f0ef-475a-9192-8c97b54a7ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:03.941869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93885e-f0ef-475a-9192-8c97b54a7ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:03.947924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93885e-f0ef-475a-9192-8c97b54a7ddc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:03.986770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1283/2581] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:03 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:03.995867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069874cf-b703-487d-a28e-b3aba064dca1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:04.008442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069874cf-b703-487d-a28e-b3aba064dca1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:04.014204 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb8786-2dfd-4992-82cb-e60bc60e1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:04.014991 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8786-2dfd-4992-82cb-e60bc60e1e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:04.015310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8786-2dfd-4992-82cb-e60bc60e1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:04.016606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8786-2dfd-4992-82cb-e60bc60e1e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:04.017212 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb8786-2dfd-4992-82cb-e60bc60e1e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:04.019421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb8786-2dfd-4992-82cb-e60bc60e1e06 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:04.030683 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1299/2582] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:32:04.035647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93885e-f0ef-475a-9192-8c97b54a7ddc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:04.048286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93885e-f0ef-475a-9192-8c97b54a7ddc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:04.053424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3f722-87e2-4173-89f4-2bba73b98ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:04.054188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3f722-87e2-4173-89f4-2bba73b98ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:04.054514 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3f722-87e2-4173-89f4-2bba73b98ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:04.054999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3f722-87e2-4173-89f4-2bba73b98ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:04.055756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3f722-87e2-4173-89f4-2bba73b98ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:04.057518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3f722-87e2-4173-89f4-2bba73b98ad8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:04.069444 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1284/2583] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:04.074217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb8786-2dfd-4992-82cb-e60bc60e1e06 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:04.085746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb8786-2dfd-4992-82cb-e60bc60e1e06 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:04.090568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:04.091241 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:04.091529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:04.091809 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] PATH_INFO: `/v3/projects/476b0352a2604c4f93ed63aa050a4942/users/8902eb02e5324b939c7b19df639c799b/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:04.118550 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476b0352a2604c4f93ed63aa050a4942, user_id=8902eb02e5324b939c7b19df639c799b, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:04.121176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:04.141620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1300/2584] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:04 2022] PUT /identity/v3/projects/476b0352a2604c4f93ed63aa050a4942/users/8902eb02e5324b939c7b19df639c799b/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:04.151792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad07d-829c-4ae9-951d-29a5ab24f65d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:04.152083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad07d-829c-4ae9-951d-29a5ab24f65d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:04.152436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad07d-829c-4ae9-951d-29a5ab24f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:04.185441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5a5ad07d-829c-4ae9-951d-29a5ab24f65d None None] MFA Rules not processed for user `8902eb02e5324b939c7b19df639c799b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:04.186983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a5ad07d-829c-4ae9-951d-29a5ab24f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:04.194430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:04.293577 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1285/2585] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:04.298537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:04.307051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:04.310743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad07d-829c-4ae9-951d-29a5ab24f65d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:04.312342 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a5ad07d-829c-4ae9-951d-29a5ab24f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:04.386036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad07d-829c-4ae9-951d-29a5ab24f65d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:04.388953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6cc96-093b-46e5-902d-be2e4c421be4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:04.390540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:04.391222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:04.391757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:04.392237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:04.396275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:04.397075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:04.397339 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:04.397642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:04.399667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:04.412826 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:04.414267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:04.426115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1286/2586] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:32:04.519568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:04.520971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:04.532909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1301/2587] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:08.721199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:08.723306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:08.741862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697866d-1e56-4ad7-a69c-d5a94bee8d05 service glance] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:08.746394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:08.747016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:08.747301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:08.747576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] PATH_INFO: `/v3/users/57d8dd7c820144a082032626cb481df7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:08.748727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d8dd7c820144a082032626cb481df7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:08.750680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:08.806282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d8dd7c820144a082032626cb481df7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:08.807007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d8dd7c820144a082032626cb481df7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:08.816526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d8dd7c820144a082032626cb481df7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:08.829330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d8dd7c820144a082032626cb481df7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:08.838560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e9f8bc6b-4d57-45c2-bed9-80055a6c6242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d8dd7c820144a082032626cb481df7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:08.844780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1287/2588] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:08 2022] DELETE /identity/v3/users/57d8dd7c820144a082032626cb481df7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:09.311947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:09.323556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244545-005a-4638-b333-83c648e45c60 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:09.447029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:09.448135 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:09.448606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:09.449055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] PATH_INFO: `/v3/projects/6f104795d5a04f6fa7b747bbbc48ab39` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:09.456722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f104795d5a04f6fa7b747bbbc48ab39)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:09.456722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:09.461457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:09.522504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f104795d5a04f6fa7b747bbbc48ab39', 'request_id': 'req-792371ad-0077-45f7-90a7-229fc78f6ef4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:09.529630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f104795d5a04f6fa7b747bbbc48ab39', 'request_id': 'req-792371ad-0077-45f7-90a7-229fc78f6ef4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:09.535090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f104795d5a04f6fa7b747bbbc48ab39', 'request_id': 'req-792371ad-0077-45f7-90a7-229fc78f6ef4'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:09.548741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] The token cache is being invalidate because project 6f104795d5a04f6fa7b747bbbc48ab39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:09.549030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:09.549780 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-792371ad-0077-45f7-90a7-229fc78f6ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:09.552356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1302/2589] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:09 2022] DELETE /identity/v3/projects/6f104795d5a04f6fa7b747bbbc48ab39 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:09.559284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aded-a613-4d88-b73e-ed66655ec6d0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:09.559665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aded-a613-4d88-b73e-ed66655ec6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:09.559989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aded-a613-4d88-b73e-ed66655ec6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:09.581017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-80a5aded-a613-4d88-b73e-ed66655ec6d0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:09.582424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-80a5aded-a613-4d88-b73e-ed66655ec6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:09.600473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:09.647436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1288/2590] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:09.655274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7b6c2-e88e-45dd-b604-32f9c656c53a None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:09.655580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7b6c2-e88e-45dd-b604-32f9c656c53a None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:09.655881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7b6c2-e88e-45dd-b604-32f9c656c53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:09.677427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-18f7b6c2-e88e-45dd-b604-32f9c656c53a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:09.678671 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-18f7b6c2-e88e-45dd-b604-32f9c656c53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:09.688726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1303/2591] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:09.693821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5aded-a613-4d88-b73e-ed66655ec6d0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:09.706133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5aded-a613-4d88-b73e-ed66655ec6d0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:09.726245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:09.726245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:09.726245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:09.726245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:09.727216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:09.727216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:09.727216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:09.740212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1289/2592] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:09.743974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7b6c2-e88e-45dd-b604-32f9c656c53a None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:09.754459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7b6c2-e88e-45dd-b604-32f9c656c53a None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:09.761383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60999e-51e0-475b-9e37-f6db66edda2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:09.762034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60999e-51e0-475b-9e37-f6db66edda2f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:09.762322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60999e-51e0-475b-9e37-f6db66edda2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:09.762595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60999e-51e0-475b-9e37-f6db66edda2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:09.763280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60999e-51e0-475b-9e37-f6db66edda2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:09.765281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60999e-51e0-475b-9e37-f6db66edda2f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:09.801788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1304/2593] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:09 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:09.803172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:09.814471 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dccd2-6228-4585-9e78-ecfeed242336 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:09.890807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab79a-0670-4dda-8c62-f3fe58a6b8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:09.891436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab79a-0670-4dda-8c62-f3fe58a6b8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:09.891721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab79a-0670-4dda-8c62-f3fe58a6b8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:09.892070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab79a-0670-4dda-8c62-f3fe58a6b8dd admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:09.892903 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab79a-0670-4dda-8c62-f3fe58a6b8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:09.895020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab79a-0670-4dda-8c62-f3fe58a6b8dd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:09.929702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1290/2594] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:09 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:09.933886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60999e-51e0-475b-9e37-f6db66edda2f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:09.946962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60999e-51e0-475b-9e37-f6db66edda2f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:09.953693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da55c4-368c-4b31-aa81-d2ca9fc2919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:09.954232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da55c4-368c-4b31-aa81-d2ca9fc2919f admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:09.954518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da55c4-368c-4b31-aa81-d2ca9fc2919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:09.954797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da55c4-368c-4b31-aa81-d2ca9fc2919f admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:09.955454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da55c4-368c-4b31-aa81-d2ca9fc2919f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:09.957169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da55c4-368c-4b31-aa81-d2ca9fc2919f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:09.968753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1305/2595] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:09.975336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab79a-0670-4dda-8c62-f3fe58a6b8dd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:09.992154 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab79a-0670-4dda-8c62-f3fe58a6b8dd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:09.997333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f93d2-9e20-4cc0-9620-7e460787d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:09.998013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f93d2-9e20-4cc0-9620-7e460787d9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:09.998311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f93d2-9e20-4cc0-9620-7e460787d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:09.998598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f93d2-9e20-4cc0-9620-7e460787d9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:09.999283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f93d2-9e20-4cc0-9620-7e460787d9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:10.000947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f93d2-9e20-4cc0-9620-7e460787d9fb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:10.016707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1291/2596] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:10.018669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da55c4-368c-4b31-aa81-d2ca9fc2919f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:10.034298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da55c4-368c-4b31-aa81-d2ca9fc2919f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:10.040215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b977663-3d54-457f-9cef-7dab3255b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:10.041065 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b977663-3d54-457f-9cef-7dab3255b0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.041354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b977663-3d54-457f-9cef-7dab3255b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.041681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b977663-3d54-457f-9cef-7dab3255b0b7 admin admin] PATH_INFO: `/v3/projects/029ac0fbc218423aafba0b2996eed740/users/53dd10b7fb5d4f16b2e7f80e2ce7a14d/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:10.058302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b977663-3d54-457f-9cef-7dab3255b0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029ac0fbc218423aafba0b2996eed740, user_id=53dd10b7fb5d4f16b2e7f80e2ce7a14d, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:10.061101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b977663-3d54-457f-9cef-7dab3255b0b7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:10.075522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1306/2597] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:10 2022] PUT /identity/v3/projects/029ac0fbc218423aafba0b2996eed740/users/53dd10b7fb5d4f16b2e7f80e2ce7a14d/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:10.086526 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042730-5255-4f7b-ae60-2b9ab3725047 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.086820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042730-5255-4f7b-ae60-2b9ab3725047 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.087104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042730-5255-4f7b-ae60-2b9ab3725047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:10.119627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-61042730-5255-4f7b-ae60-2b9ab3725047 None None] MFA Rules not processed for user `53dd10b7fb5d4f16b2e7f80e2ce7a14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:10.120929 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-61042730-5255-4f7b-ae60-2b9ab3725047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:10.212839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1292/2598] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:10.217527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b977663-3d54-457f-9cef-7dab3255b0b7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:10.319051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b977663-3d54-457f-9cef-7dab3255b0b7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:10.324480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068cafd-890c-4c49-ba8e-ad5374456f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:10.325109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cafd-890c-4c49-ba8e-ad5374456f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.325385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cafd-890c-4c49-ba8e-ad5374456f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.325700 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cafd-890c-4c49-ba8e-ad5374456f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:10.326374 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068cafd-890c-4c49-ba8e-ad5374456f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:10.328360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068cafd-890c-4c49-ba8e-ad5374456f45 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:10.368186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1307/2599] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:10 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:10.369495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042730-5255-4f7b-ae60-2b9ab3725047 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:10.384318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042730-5255-4f7b-ae60-2b9ab3725047 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:10.403636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:10.481231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba894-d1c3-44c7-8cff-1e9d25ba3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:10.482379 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba894-d1c3-44c7-8cff-1e9d25ba3a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.482671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba894-d1c3-44c7-8cff-1e9d25ba3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.482942 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba894-d1c3-44c7-8cff-1e9d25ba3a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:10.483590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba894-d1c3-44c7-8cff-1e9d25ba3a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:10.485562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba894-d1c3-44c7-8cff-1e9d25ba3a75 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:10.545855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1293/2600] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:10 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:10.552008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068cafd-890c-4c49-ba8e-ad5374456f45 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:10.571231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068cafd-890c-4c49-ba8e-ad5374456f45 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:10.574005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af15b9-38e4-4509-bf89-d7c4a7b4ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:10.575003 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af15b9-38e4-4509-bf89-d7c4a7b4ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.575460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af15b9-38e4-4509-bf89-d7c4a7b4ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.576450 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af15b9-38e4-4509-bf89-d7c4a7b4ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:10.576951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af15b9-38e4-4509-bf89-d7c4a7b4ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:10.579836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af15b9-38e4-4509-bf89-d7c4a7b4ba46 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:10.598207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1308/2601] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:10.603493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba894-d1c3-44c7-8cff-1e9d25ba3a75 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:10.617992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba894-d1c3-44c7-8cff-1e9d25ba3a75 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:10.623383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8e81-24b9-4b59-844d-564f31384bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:10.624318 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8e81-24b9-4b59-844d-564f31384bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.624707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8e81-24b9-4b59-844d-564f31384bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.625198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8e81-24b9-4b59-844d-564f31384bb9 admin admin] PATH_INFO: `/v3/projects/b18cb6118c03421fb32e5d106f5adbce/users/1fb5178adcd94729917ffe0d8a5f8475/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:10.649184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e8e81-24b9-4b59-844d-564f31384bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18cb6118c03421fb32e5d106f5adbce, user_id=1fb5178adcd94729917ffe0d8a5f8475, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:10.653579 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e8e81-24b9-4b59-844d-564f31384bb9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:10.671585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1294/2602] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:10 2022] PUT /identity/v3/projects/b18cb6118c03421fb32e5d106f5adbce/users/1fb5178adcd94729917ffe0d8a5f8475/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:10.676511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af15b9-38e4-4509-bf89-d7c4a7b4ba46 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:10.683181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:10.691061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af15b9-38e4-4509-bf89-d7c4a7b4ba46 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:10.854548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97abad-051e-4311-b6ff-7c8f6319c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:10.855262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97abad-051e-4311-b6ff-7c8f6319c26d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.855455 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97abad-051e-4311-b6ff-7c8f6319c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.856110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97abad-051e-4311-b6ff-7c8f6319c26d admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:10.857177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97abad-051e-4311-b6ff-7c8f6319c26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:10.860922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97abad-051e-4311-b6ff-7c8f6319c26d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:10.886731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8e81-24b9-4b59-844d-564f31384bb9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:10.890164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1309/2603] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:10.915454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8e81-24b9-4b59-844d-564f31384bb9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:10.923072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:10.924578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.925193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.925757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] PATH_INFO: `/v3/projects/b18cb6118c03421fb32e5d106f5adbce/users/1fb5178adcd94729917ffe0d8a5f8475/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:10.929829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18cb6118c03421fb32e5d106f5adbce, user_id=1fb5178adcd94729917ffe0d8a5f8475, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:10.937382 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:10.974176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1295/2604] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:10 2022] PUT /identity/v3/projects/b18cb6118c03421fb32e5d106f5adbce/users/1fb5178adcd94729917ffe0d8a5f8475/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:10.991745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17238a3-f114-4d9a-a906-b65103fc4f50 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:10.992332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17238a3-f114-4d9a-a906-b65103fc4f50 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:10.992681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17238a3-f114-4d9a-a906-b65103fc4f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:11.043146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c17238a3-f114-4d9a-a906-b65103fc4f50 None None] MFA Rules not processed for user `1fb5178adcd94729917ffe0d8a5f8475`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:11.044474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c17238a3-f114-4d9a-a906-b65103fc4f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:11.164481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1310/2605] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:11.180402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:11.182947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:11.307901 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878a3d-c2d0-421f-a1c3-95c077c2d326 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:11.312879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202283d-6a18-49d2-bb6c-21fccffdaf8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:11.313295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202283d-6a18-49d2-bb6c-21fccffdaf8d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:11.313615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202283d-6a18-49d2-bb6c-21fccffdaf8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:11.313899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202283d-6a18-49d2-bb6c-21fccffdaf8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:11.329488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202283d-6a18-49d2-bb6c-21fccffdaf8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:11.331021 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202283d-6a18-49d2-bb6c-21fccffdaf8d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:11.353595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1296/2606] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:12.070118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17238a3-f114-4d9a-a906-b65103fc4f50 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:12.136310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f01e-4bb5-4263-b889-b0fa965d6f41 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:12.136859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f01e-4bb5-4263-b889-b0fa965d6f41 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:12.137173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f01e-4bb5-4263-b889-b0fa965d6f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:12.162760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0a36f01e-4bb5-4263-b889-b0fa965d6f41 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:12.164239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a36f01e-4bb5-4263-b889-b0fa965d6f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:12.177043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17238a3-f114-4d9a-a906-b65103fc4f50 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:12.182598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:12.183259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:12.183554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:12.183815 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] PATH_INFO: `/v3/users/53dd10b7fb5d4f16b2e7f80e2ce7a14d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:12.185068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53dd10b7fb5d4f16b2e7f80e2ce7a14d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:12.187266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:12.245155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:12.263979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1297/2607] 10.222.0.15 () {58 vars in 967 bytes} [Thu Oct 6 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:12.282574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53dd10b7fb5d4f16b2e7f80e2ce7a14d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:12.283702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53dd10b7fb5d4f16b2e7f80e2ce7a14d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:12.284353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53dd10b7fb5d4f16b2e7f80e2ce7a14d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:12.303372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53dd10b7fb5d4f16b2e7f80e2ce7a14d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:12.314770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-edadeab9-4861-4e21-9257-644a87f21ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53dd10b7fb5d4f16b2e7f80e2ce7a14d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:12.324107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f01e-4bb5-4263-b889-b0fa965d6f41 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:12.326870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a36f01e-4bb5-4263-b889-b0fa965d6f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:12.340736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1311/2608] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:12 2022] DELETE /identity/v3/users/53dd10b7fb5d4f16b2e7f80e2ce7a14d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:12.343031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171af48-3110-447d-be41-18079a45ebbe None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:12.343330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171af48-3110-447d-be41-18079a45ebbe None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:12.343608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171af48-3110-447d-be41-18079a45ebbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:12.360445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:12.381125 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-f171af48-3110-447d-be41-18079a45ebbe None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:12.382448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f171af48-3110-447d-be41-18079a45ebbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:12.428814 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f01e-4bb5-4263-b889-b0fa965d6f41 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:12.482536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1312/2609] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:12.514159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171af48-3110-447d-be41-18079a45ebbe None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:12.516437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f171af48-3110-447d-be41-18079a45ebbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:12.539301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:12.539852 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:12.540138 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:12.540414 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:12.542620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:12.652075 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:12.654363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:12.670714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171af48-3110-447d-be41-18079a45ebbe None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:12.671011 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1298/2610] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:32:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:32:12.674936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f445d-bb30-4343-b900-72f01607e460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:12.675685 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f445d-bb30-4343-b900-72f01607e460 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:12.676779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f445d-bb30-4343-b900-72f01607e460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:12.677885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f445d-bb30-4343-b900-72f01607e460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:12.698797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f445d-bb30-4343-b900-72f01607e460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:12.706634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f445d-bb30-4343-b900-72f01607e460 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:12.722802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1313/2611] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:13.145664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:13.147223 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:13.167068 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f781bc-c216-47be-a71f-03e1222197d6 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:13.187775 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:13.188681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:13.189215 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:13.189727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] PATH_INFO: `/v3/projects/029ac0fbc218423aafba0b2996eed740` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:13.191279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029ac0fbc218423aafba0b2996eed740)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:13.193524 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:13.292508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029ac0fbc218423aafba0b2996eed740', 'request_id': 'req-2f4b0571-82a2-41f5-8964-1107dbf34722'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.304876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029ac0fbc218423aafba0b2996eed740', 'request_id': 'req-2f4b0571-82a2-41f5-8964-1107dbf34722'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.306591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:13.320225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029ac0fbc218423aafba0b2996eed740', 'request_id': 'req-2f4b0571-82a2-41f5-8964-1107dbf34722'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.335512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] The token cache is being invalidate because project 029ac0fbc218423aafba0b2996eed740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:13.335959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.336725 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.338843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1299/2612] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:13 2022] DELETE /identity/v3/projects/029ac0fbc218423aafba0b2996eed740 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:13.343726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f445d-bb30-4343-b900-72f01607e460 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:13.355735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f445d-bb30-4343-b900-72f01607e460 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:13.413519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:13.441678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:13.442722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:13.443032 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:13.443280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] PATH_INFO: `/v3/users/1fb5178adcd94729917ffe0d8a5f8475` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:13.444689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb5178adcd94729917ffe0d8a5f8475)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:13.446976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:13.537563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb5178adcd94729917ffe0d8a5f8475'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.538256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb5178adcd94729917ffe0d8a5f8475'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.538874 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb5178adcd94729917ffe0d8a5f8475'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.562834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb5178adcd94729917ffe0d8a5f8475'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.584575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-7f6899fe-4ed8-47e7-b1a4-fd4c4496ea17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb5178adcd94729917ffe0d8a5f8475'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:13.605607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1314/2613] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:13 2022] DELETE /identity/v3/users/1fb5178adcd94729917ffe0d8a5f8475 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:14.292518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:14.297132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:14.318128 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0571-82a2-41f5-8964-1107dbf34722 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:14.421806 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:14.423510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:14.424071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:14.424419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] PATH_INFO: `/v3/projects/b18cb6118c03421fb32e5d106f5adbce` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:14.426855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18cb6118c03421fb32e5d106f5adbce)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:14.429272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:14.491363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18cb6118c03421fb32e5d106f5adbce', 'request_id': 'req-3deb53ee-8246-43c9-adcd-6e6dd12407c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:14.502103 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18cb6118c03421fb32e5d106f5adbce', 'request_id': 'req-3deb53ee-8246-43c9-adcd-6e6dd12407c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:14.510972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18cb6118c03421fb32e5d106f5adbce', 'request_id': 'req-3deb53ee-8246-43c9-adcd-6e6dd12407c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:14.530396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] The token cache is being invalidate because project b18cb6118c03421fb32e5d106f5adbce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:14.532327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:14.533289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3deb53ee-8246-43c9-adcd-6e6dd12407c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:14.535884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1300/2614] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:14 2022] DELETE /identity/v3/projects/b18cb6118c03421fb32e5d106f5adbce => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:14.541008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce831ac-b16a-421a-ac10-52f4651defeb None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:14.541576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce831ac-b16a-421a-ac10-52f4651defeb None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:14.541576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce831ac-b16a-421a-ac10-52f4651defeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:14.573905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-2ce831ac-b16a-421a-ac10-52f4651defeb None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:14.575175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2ce831ac-b16a-421a-ac10-52f4651defeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:14.729518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1315/2615] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:14.741947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5213a-5a0a-4d6d-9433-cd5ae9e2e1f1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:14.743987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5213a-5a0a-4d6d-9433-cd5ae9e2e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:14.745951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5213a-5a0a-4d6d-9433-cd5ae9e2e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:14.773998 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4df5213a-5a0a-4d6d-9433-cd5ae9e2e1f1 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:14.776398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4df5213a-5a0a-4d6d-9433-cd5ae9e2e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:14.797996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1301/2616] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:14.802233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce831ac-b16a-421a-ac10-52f4651defeb None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:14.839505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce831ac-b16a-421a-ac10-52f4651defeb None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:14.852710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:14.855606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:14.856920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:14.857430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:14.858631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:14.860311 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:14.862209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:14.887283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1316/2617] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:14.893625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5213a-5a0a-4d6d-9433-cd5ae9e2e1f1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:14.918423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5213a-5a0a-4d6d-9433-cd5ae9e2e1f1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:14.923838 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb41a8-6f3a-44a8-bd75-715b703ea17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:14.924461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb41a8-6f3a-44a8-bd75-715b703ea17c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:14.924782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb41a8-6f3a-44a8-bd75-715b703ea17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:14.925089 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb41a8-6f3a-44a8-bd75-715b703ea17c admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:14.925821 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb41a8-6f3a-44a8-bd75-715b703ea17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:14.929561 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb41a8-6f3a-44a8-bd75-715b703ea17c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:14.962916 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1302/2618] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:14 2022] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:14.968342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:14.980168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66a5a9-e1bc-4061-9665-ccc2d4f0b423 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.042753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:15.055021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881c380-9bcf-4cf9-9670-685d39bac8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.056157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881c380-9bcf-4cf9-9670-685d39bac8fd admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.057338 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881c380-9bcf-4cf9-9670-685d39bac8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.057830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881c380-9bcf-4cf9-9670-685d39bac8fd admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.058840 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881c380-9bcf-4cf9-9670-685d39bac8fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.061410 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881c380-9bcf-4cf9-9670-685d39bac8fd admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.091106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1317/2619] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:14 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:15.092664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb41a8-6f3a-44a8-bd75-715b703ea17c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.105715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb41a8-6f3a-44a8-bd75-715b703ea17c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.117647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc6d4d-5ec1-486f-abd6-318c268201de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.118357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc6d4d-5ec1-486f-abd6-318c268201de admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.118647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc6d4d-5ec1-486f-abd6-318c268201de admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.118963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc6d4d-5ec1-486f-abd6-318c268201de admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.119714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc6d4d-5ec1-486f-abd6-318c268201de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.121339 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc6d4d-5ec1-486f-abd6-318c268201de admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.134218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1303/2620] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:15.138017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881c380-9bcf-4cf9-9670-685d39bac8fd admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.149624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881c380-9bcf-4cf9-9670-685d39bac8fd admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.154371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf2083-94bc-42ee-a4ac-ba8eb3a74848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.154985 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf2083-94bc-42ee-a4ac-ba8eb3a74848 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.155266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf2083-94bc-42ee-a4ac-ba8eb3a74848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.155540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf2083-94bc-42ee-a4ac-ba8eb3a74848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.156195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf2083-94bc-42ee-a4ac-ba8eb3a74848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.157860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf2083-94bc-42ee-a4ac-ba8eb3a74848 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.169387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1318/2621] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:32:15.173568 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc6d4d-5ec1-486f-abd6-318c268201de admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.184797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc6d4d-5ec1-486f-abd6-318c268201de admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.190005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09cea2-6f03-4a4e-90af-33ca50d466d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.190271 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cea2-6f03-4a4e-90af-33ca50d466d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.190543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cea2-6f03-4a4e-90af-33ca50d466d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.190822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cea2-6f03-4a4e-90af-33ca50d466d6 admin admin] PATH_INFO: `/v3/projects/e1dbb82e02f84c7eb257ca6e7888ddad/users/372a247376274463a699ad1be200f4de/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.217741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09cea2-6f03-4a4e-90af-33ca50d466d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1dbb82e02f84c7eb257ca6e7888ddad, user_id=372a247376274463a699ad1be200f4de, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.222112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09cea2-6f03-4a4e-90af-33ca50d466d6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.239147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1304/2622] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:15 2022] PUT /identity/v3/projects/e1dbb82e02f84c7eb257ca6e7888ddad/users/372a247376274463a699ad1be200f4de/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:15.250379 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b257-7ac9-44bf-82a8-9a19973d9076 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.250714 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b257-7ac9-44bf-82a8-9a19973d9076 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.250940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b257-7ac9-44bf-82a8-9a19973d9076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.289164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ff40b257-7ac9-44bf-82a8-9a19973d9076 None None] MFA Rules not processed for user `372a247376274463a699ad1be200f4de`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:15.291681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ff40b257-7ac9-44bf-82a8-9a19973d9076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:15.387057 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1319/2623] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:15.391524 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09cea2-6f03-4a4e-90af-33ca50d466d6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.411999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:15.478771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09cea2-6f03-4a4e-90af-33ca50d466d6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.486629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d644c9-8ccf-430d-8b40-5fb99944ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.487285 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d644c9-8ccf-430d-8b40-5fb99944ea60 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.487568 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d644c9-8ccf-430d-8b40-5fb99944ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.487844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d644c9-8ccf-430d-8b40-5fb99944ea60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.488494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d644c9-8ccf-430d-8b40-5fb99944ea60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.491199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d644c9-8ccf-430d-8b40-5fb99944ea60 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.530312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1305/2624] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:15 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:15.531113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40b257-7ac9-44bf-82a8-9a19973d9076 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.543778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40b257-7ac9-44bf-82a8-9a19973d9076 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.619298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d174e6-8395-403e-b4ca-b4cb6e3c6845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.620287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d174e6-8395-403e-b4ca-b4cb6e3c6845 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.620811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d174e6-8395-403e-b4ca-b4cb6e3c6845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.621290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d174e6-8395-403e-b4ca-b4cb6e3c6845 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.622340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d174e6-8395-403e-b4ca-b4cb6e3c6845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.624563 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d174e6-8395-403e-b4ca-b4cb6e3c6845 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.655963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1320/2625] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:15 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:15.657628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d644c9-8ccf-430d-8b40-5fb99944ea60 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.670179 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d644c9-8ccf-430d-8b40-5fb99944ea60 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.675727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a6829-9dbb-45ec-a19c-013ce873d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.677183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6829-9dbb-45ec-a19c-013ce873d697 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.677695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6829-9dbb-45ec-a19c-013ce873d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.678139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6829-9dbb-45ec-a19c-013ce873d697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.679217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a6829-9dbb-45ec-a19c-013ce873d697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.681180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a6829-9dbb-45ec-a19c-013ce873d697 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.694970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1306/2626] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:15.699927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d174e6-8395-403e-b4ca-b4cb6e3c6845 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.711603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d174e6-8395-403e-b4ca-b4cb6e3c6845 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.717096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2712-2d87-4d3c-9e43-22d5d6f0cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.718083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2712-2d87-4d3c-9e43-22d5d6f0cdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.718544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2712-2d87-4d3c-9e43-22d5d6f0cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.719320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2712-2d87-4d3c-9e43-22d5d6f0cdcc admin admin] PATH_INFO: `/v3/projects/805c7e2dc63a4fcc82a33af48be2c992/users/639a89ec202e4173858d29c7e744905e/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.741814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2712-2d87-4d3c-9e43-22d5d6f0cdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=805c7e2dc63a4fcc82a33af48be2c992, user_id=639a89ec202e4173858d29c7e744905e, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.745087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2712-2d87-4d3c-9e43-22d5d6f0cdcc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.765669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1321/2627] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:15 2022] PUT /identity/v3/projects/805c7e2dc63a4fcc82a33af48be2c992/users/639a89ec202e4173858d29c7e744905e/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:15.767918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a6829-9dbb-45ec-a19c-013ce873d697 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.781516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a6829-9dbb-45ec-a19c-013ce873d697 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.860107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2d736-f228-4d66-be30-b34a6cbb3299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.860759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d736-f228-4d66-be30-b34a6cbb3299 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.861107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d736-f228-4d66-be30-b34a6cbb3299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.861338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d736-f228-4d66-be30-b34a6cbb3299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.862039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2d736-f228-4d66-be30-b34a6cbb3299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.863762 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2d736-f228-4d66-be30-b34a6cbb3299 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.876376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1307/2628] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:15.881372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2712-2d87-4d3c-9e43-22d5d6f0cdcc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:15.892434 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2712-2d87-4d3c-9e43-22d5d6f0cdcc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:15.899693 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:15.901802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.902221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.902500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] PATH_INFO: `/v3/projects/805c7e2dc63a4fcc82a33af48be2c992/users/639a89ec202e4173858d29c7e744905e/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:15.904962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805c7e2dc63a4fcc82a33af48be2c992, user_id=639a89ec202e4173858d29c7e744905e, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:15.907707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:15.941812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1322/2629] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:15 2022] PUT /identity/v3/projects/805c7e2dc63a4fcc82a33af48be2c992/users/639a89ec202e4173858d29c7e744905e/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:15.950807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428954f9-d535-44f5-b2bd-95dd03b0f0b8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:15.950807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428954f9-d535-44f5-b2bd-95dd03b0f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:15.950807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428954f9-d535-44f5-b2bd-95dd03b0f0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:16.014782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-428954f9-d535-44f5-b2bd-95dd03b0f0b8 None None] MFA Rules not processed for user `639a89ec202e4173858d29c7e744905e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:16.016245 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-428954f9-d535-44f5-b2bd-95dd03b0f0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:16.107398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1308/2630] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:16.121707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:16.123694 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:16.149343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:16.203933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1d8f5-c468-43ea-880d-dab12971c894 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:16.208866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:16.209473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:16.209804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:16.210110 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:16.227526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:16.229047 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:16.239803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1323/2631] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:16.330307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428954f9-d535-44f5-b2bd-95dd03b0f0b8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:16.351326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428954f9-d535-44f5-b2bd-95dd03b0f0b8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:16.357065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251489dd-e7e4-4f32-ae11-8be968e31fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:16.357954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251489dd-e7e4-4f32-ae11-8be968e31fbe service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:16.358334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251489dd-e7e4-4f32-ae11-8be968e31fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:16.358672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251489dd-e7e4-4f32-ae11-8be968e31fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:16.363582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:16.450098 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251489dd-e7e4-4f32-ae11-8be968e31fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:16.455480 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251489dd-e7e4-4f32-ae11-8be968e31fbe service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:16.463639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1309/2632] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:17.345416 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:17.346962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:17.421432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23736fa-85c8-4645-a42f-190edb569ecd service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:17.427386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8a410-4ed4-47ac-9d8a-3457e22a294e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:17.428036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a410-4ed4-47ac-9d8a-3457e22a294e service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:17.428328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a410-4ed4-47ac-9d8a-3457e22a294e service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:17.428599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a410-4ed4-47ac-9d8a-3457e22a294e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:17.430769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fdf8a410-4ed4-47ac-9d8a-3457e22a294e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:17.503439 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8a410-4ed4-47ac-9d8a-3457e22a294e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:17.504913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8a410-4ed4-47ac-9d8a-3457e22a294e service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:17.517829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1324/2633] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:19.459933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251489dd-e7e4-4f32-ae11-8be968e31fbe service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:19.472853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251489dd-e7e4-4f32-ae11-8be968e31fbe service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:19.481210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:19.482035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:19.482415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:19.482788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] PATH_INFO: `/v3/users/372a247376274463a699ad1be200f4de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:19.485610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=372a247376274463a699ad1be200f4de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:19.488023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:19.567635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372a247376274463a699ad1be200f4de'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:19.568830 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372a247376274463a699ad1be200f4de'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:19.585443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372a247376274463a699ad1be200f4de'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:19.604624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372a247376274463a699ad1be200f4de'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:19.615736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372a247376274463a699ad1be200f4de'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:19.628794 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1310/2634] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:19 2022] DELETE /identity/v3/users/372a247376274463a699ad1be200f4de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:19.633881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689c31-fe3c-4aa7-8ab9-5c001578a654 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:19.634416 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689c31-fe3c-4aa7-8ab9-5c001578a654 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:19.634832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689c31-fe3c-4aa7-8ab9-5c001578a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:19.658540 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-02689c31-fe3c-4aa7-8ab9-5c001578a654 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:19.659891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-02689c31-fe3c-4aa7-8ab9-5c001578a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:19.733626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1325/2635] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:19.743647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:19.745277 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:19.825252 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327865-683c-45dd-a60c-ee43a8cb9bfa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:19.830174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23055f-e1d9-471b-8abf-6a753f7be5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:19.830801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23055f-e1d9-471b-8abf-6a753f7be5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:19.831077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23055f-e1d9-471b-8abf-6a753f7be5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:19.831362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23055f-e1d9-471b-8abf-6a753f7be5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:19.846918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23055f-e1d9-471b-8abf-6a753f7be5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:19.848397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23055f-e1d9-471b-8abf-6a753f7be5f1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:19.873317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1311/2636] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:20.238097 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02689c31-fe3c-4aa7-8ab9-5c001578a654 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:20.240270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-02689c31-fe3c-4aa7-8ab9-5c001578a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:20.256869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02689c31-fe3c-4aa7-8ab9-5c001578a654 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:20.262193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:20.263035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:20.263364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:20.263641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] PATH_INFO: `/v3/projects/e1dbb82e02f84c7eb257ca6e7888ddad` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:20.264907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1dbb82e02f84c7eb257ca6e7888ddad)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:20.266910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:20.268684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:20.366386 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1dbb82e02f84c7eb257ca6e7888ddad', 'request_id': 'req-4cfaa682-8167-429b-9c0e-f2a34c45309f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.375719 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1dbb82e02f84c7eb257ca6e7888ddad', 'request_id': 'req-4cfaa682-8167-429b-9c0e-f2a34c45309f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.392975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1dbb82e02f84c7eb257ca6e7888ddad', 'request_id': 'req-4cfaa682-8167-429b-9c0e-f2a34c45309f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.413894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] The token cache is being invalidate because project e1dbb82e02f84c7eb257ca6e7888ddad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:20.414277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.415009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.416867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1326/2637] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:20 2022] DELETE /identity/v3/projects/e1dbb82e02f84c7eb257ca6e7888ddad => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:20.421040 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23055f-e1d9-471b-8abf-6a753f7be5f1 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:20.437820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23055f-e1d9-471b-8abf-6a753f7be5f1 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:20.477023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:20.546079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:20.546841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:20.547153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:20.547498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] PATH_INFO: `/v3/users/639a89ec202e4173858d29c7e744905e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:20.548709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] RBAC: Authorizing `identity:delete_user(user_id=639a89ec202e4173858d29c7e744905e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:20.550690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:20.616314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639a89ec202e4173858d29c7e744905e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.617020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639a89ec202e4173858d29c7e744905e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.626669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639a89ec202e4173858d29c7e744905e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.651525 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639a89ec202e4173858d29c7e744905e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.659474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-05cd1140-975c-48fa-b393-54246055521a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639a89ec202e4173858d29c7e744905e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:20.674933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1312/2638] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:20 2022] DELETE /identity/v3/users/639a89ec202e4173858d29c7e744905e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:21.525741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:21.528140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:21.561472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa682-8167-429b-9c0e-f2a34c45309f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:21.632571 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:21.633242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:21.633520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:21.633849 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] PATH_INFO: `/v3/projects/805c7e2dc63a4fcc82a33af48be2c992` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:21.635586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805c7e2dc63a4fcc82a33af48be2c992)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:21.637877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:21.702309 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805c7e2dc63a4fcc82a33af48be2c992', 'request_id': 'req-a380cfbb-6ad9-4d18-a86d-4f98622629e2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:21.710557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805c7e2dc63a4fcc82a33af48be2c992', 'request_id': 'req-a380cfbb-6ad9-4d18-a86d-4f98622629e2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:21.717158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805c7e2dc63a4fcc82a33af48be2c992', 'request_id': 'req-a380cfbb-6ad9-4d18-a86d-4f98622629e2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:21.748536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] The token cache is being invalidate because project 805c7e2dc63a4fcc82a33af48be2c992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:21.748839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:21.751336 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a380cfbb-6ad9-4d18-a86d-4f98622629e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:21.754362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1327/2639] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:21 2022] DELETE /identity/v3/projects/805c7e2dc63a4fcc82a33af48be2c992 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:21.761518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247cd3e-4149-4fdf-af92-036cd0864877 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:21.762126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247cd3e-4149-4fdf-af92-036cd0864877 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:21.762126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247cd3e-4149-4fdf-af92-036cd0864877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:21.816495 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9247cd3e-4149-4fdf-af92-036cd0864877 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:21.819157 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9247cd3e-4149-4fdf-af92-036cd0864877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:21.941469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1313/2640] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:21.950501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3903a-a9f1-4eb0-b965-8c27a448c71b None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:21.951650 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3903a-a9f1-4eb0-b965-8c27a448c71b None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:21.952195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3903a-a9f1-4eb0-b965-8c27a448c71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.011595 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-acb3903a-a9f1-4eb0-b965-8c27a448c71b None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:22.013209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-acb3903a-a9f1-4eb0-b965-8c27a448c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:22.025074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1328/2641] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:22.029979 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247cd3e-4149-4fdf-af92-036cd0864877 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.046590 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247cd3e-4149-4fdf-af92-036cd0864877 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:22.052390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:22.053917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.055388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.056007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.057169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:22.057993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:22.060377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:22.087095 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1314/2642] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:22.091752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3903a-a9f1-4eb0-b965-8c27a448c71b None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.105769 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3903a-a9f1-4eb0-b965-8c27a448c71b None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:22.116423 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:22.117159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.117445 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.117768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.118442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:22.121294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:22.150217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:22.195620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.195924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1329/2643] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:22 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:22.218972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b54a-e936-482a-bfa8-bd468d252767 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:22.321125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:22.378588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.382857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:22.431248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242197-4de9-4e89-aafa-35b24c98701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:22.432058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242197-4de9-4e89-aafa-35b24c98701c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.432591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242197-4de9-4e89-aafa-35b24c98701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.435625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242197-4de9-4e89-aafa-35b24c98701c admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.437023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10242197-4de9-4e89-aafa-35b24c98701c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:22.441874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10242197-4de9-4e89-aafa-35b24c98701c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:22.472565 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1315/2644] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:22 2022] POST /identity/v3/users => generated 291 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:22.478352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242197-4de9-4e89-aafa-35b24c98701c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.492009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242197-4de9-4e89-aafa-35b24c98701c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:22.499340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516332d-8cc3-4d7d-8429-4cd1a99fb6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:22.499970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516332d-8cc3-4d7d-8429-4cd1a99fb6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.500247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516332d-8cc3-4d7d-8429-4cd1a99fb6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.500520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516332d-8cc3-4d7d-8429-4cd1a99fb6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.501473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516332d-8cc3-4d7d-8429-4cd1a99fb6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:22.507989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64858dc-ed38-470d-9611-7711e5606c83 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:22.510083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516332d-8cc3-4d7d-8429-4cd1a99fb6ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:22.518022 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:22.518742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.519211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.519520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] PATH_INFO: `/v3/users/124d46b9c4d94ddfac10753c766b52b3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.520980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] RBAC: Authorizing `identity:delete_user(user_id=124d46b9c4d94ddfac10753c766b52b3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:22.524934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:22.533676 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1316/2645] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:22.537629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516332d-8cc3-4d7d-8429-4cd1a99fb6ba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.553180 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516332d-8cc3-4d7d-8429-4cd1a99fb6ba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:22.559703 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:22.560453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.560894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.561082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.561737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:22.563844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:22.582610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1317/2646] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:32:22.584419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.588124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:22.615483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124d46b9c4d94ddfac10753c766b52b3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.615483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124d46b9c4d94ddfac10753c766b52b3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.616089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124d46b9c4d94ddfac10753c766b52b3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.622009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c82098-9ee9-4a73-8b63-baf92cc6c0ea admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:22.628160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:22.628954 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.629103 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.629380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] PATH_INFO: `/v3/users/5db54e523d0f41c29b5da5ec093237bd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.630926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db54e523d0f41c29b5da5ec093237bd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:22.632716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:22.634737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124d46b9c4d94ddfac10753c766b52b3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.643854 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124d46b9c4d94ddfac10753c766b52b3'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.659513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1330/2647] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:22 2022] DELETE /identity/v3/users/124d46b9c4d94ddfac10753c766b52b3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:22.663925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.664963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:22.713182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db54e523d0f41c29b5da5ec093237bd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.713802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db54e523d0f41c29b5da5ec093237bd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.727718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db54e523d0f41c29b5da5ec093237bd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.757707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db54e523d0f41c29b5da5ec093237bd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.768318 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d83cb2-3f56-4891-8449-05b1d29f09de admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:22.775696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-830aa420-9227-40f3-8da1-6fe09e51310a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db54e523d0f41c29b5da5ec093237bd'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:22.777176 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:22.777905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.778192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.778471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] PATH_INFO: `/v3/projects/a9062e29ff8e4abab29b564116f5e147/users/f028c3c2f17d4d0982068881cdf61e90/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.794329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1318/2648] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:22 2022] DELETE /identity/v3/users/5db54e523d0f41c29b5da5ec093237bd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:22.807736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9062e29ff8e4abab29b564116f5e147, user_id=f028c3c2f17d4d0982068881cdf61e90, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:22.811302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:22.814688 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:22.836293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1331/2649] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:22 2022] PUT /identity/v3/projects/a9062e29ff8e4abab29b564116f5e147/users/f028c3c2f17d4d0982068881cdf61e90/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:22.849558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a18e7-bc55-4da4-9c95-b26fbf3d80c6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:22.850473 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a18e7-bc55-4da4-9c95-b26fbf3d80c6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:22.851137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a18e7-bc55-4da4-9c95-b26fbf3d80c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:22.890889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b06a18e7-bc55-4da4-9c95-b26fbf3d80c6 None None] MFA Rules not processed for user `f028c3c2f17d4d0982068881cdf61e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:22.894800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b06a18e7-bc55-4da4-9c95-b26fbf3d80c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:22.980872 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:22.988428 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:22.992194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:22.998716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1319/2650] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:23.004120 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a18e7-bc55-4da4-9c95-b26fbf3d80c6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.007487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b06a18e7-bc55-4da4-9c95-b26fbf3d80c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.112951 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a18e7-bc55-4da4-9c95-b26fbf3d80c6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.119384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.120957 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.121248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.121554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.122216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.124144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.124321 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f0f81-c0c0-4b34-946f-742b95c313f6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.130093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.132016 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.132529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.132879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] PATH_INFO: `/v3/projects/b75d733b34d3469f9d46d63fd0b54ca0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.134268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75d733b34d3469f9d46d63fd0b54ca0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.136351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.155313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1320/2651] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:23 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:23.156454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.158106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.210264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75d733b34d3469f9d46d63fd0b54ca0', 'request_id': 'req-a0da3b89-5361-4a99-b634-ec0d415b2bbf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.217148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75d733b34d3469f9d46d63fd0b54ca0', 'request_id': 'req-a0da3b89-5361-4a99-b634-ec0d415b2bbf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.225606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75d733b34d3469f9d46d63fd0b54ca0', 'request_id': 'req-a0da3b89-5361-4a99-b634-ec0d415b2bbf'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.229827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d1309-bd2a-4b9d-accf-66925310ae34 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.242535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] The token cache is being invalidate because project b75d733b34d3469f9d46d63fd0b54ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:23.243209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.244194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.246814 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1332/2652] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:22 2022] DELETE /identity/v3/projects/b75d733b34d3469f9d46d63fd0b54ca0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:23.248266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.250725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.299966 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.300606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.300888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.301165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] PATH_INFO: `/v3/projects/e853ba960c00478e80988ea1f71532e2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.302353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e853ba960c00478e80988ea1f71532e2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.304360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.333640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da3b89-5361-4a99-b634-ec0d415b2bbf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.341666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90d7f6-49d7-4920-bd39-e0ea05326183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.342290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d7f6-49d7-4920-bd39-e0ea05326183 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.342577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d7f6-49d7-4920-bd39-e0ea05326183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.342883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d7f6-49d7-4920-bd39-e0ea05326183 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.343616 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90d7f6-49d7-4920-bd39-e0ea05326183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.345594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90d7f6-49d7-4920-bd39-e0ea05326183 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.350754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:23.367004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e853ba960c00478e80988ea1f71532e2', 'request_id': 'req-d2e87931-99b8-4714-a7dd-e064a89ecd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.370267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1333/2653] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:23 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:23.371624 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6fe6f-3dba-4df8-9640-5009b610a8f0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.371919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6fe6f-3dba-4df8-9640-5009b610a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.372169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6fe6f-3dba-4df8-9640-5009b610a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.378828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e853ba960c00478e80988ea1f71532e2', 'request_id': 'req-d2e87931-99b8-4714-a7dd-e064a89ecd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.386302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e853ba960c00478e80988ea1f71532e2', 'request_id': 'req-d2e87931-99b8-4714-a7dd-e064a89ecd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.393363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1db6fe6f-3dba-4df8-9640-5009b610a8f0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:23.394597 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1db6fe6f-3dba-4df8-9640-5009b610a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.402648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] The token cache is being invalidate because project e853ba960c00478e80988ea1f71532e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:23.402922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.403631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.405589 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1321/2654] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:23 2022] DELETE /identity/v3/projects/e853ba960c00478e80988ea1f71532e2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:23.406459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.408547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.411064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:23.483848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87931-99b8-4714-a7dd-e064a89ecd61 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.484083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1334/2655] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:23.484848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6fe6f-3dba-4df8-9640-5009b610a8f0 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.486137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1db6fe6f-3dba-4df8-9640-5009b610a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.492270 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6514ba9-c422-4727-b956-b63615460fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.492910 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6514ba9-c422-4727-b956-b63615460fde admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.493197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6514ba9-c422-4727-b956-b63615460fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.493476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6514ba9-c422-4727-b956-b63615460fde admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.494248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6514ba9-c422-4727-b956-b63615460fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.495870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6514ba9-c422-4727-b956-b63615460fde admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.499698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6fe6f-3dba-4df8-9640-5009b610a8f0 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.504674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.505316 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.505629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.506397 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] PATH_INFO: `/v3/users/bde2a78e7e4c48ddbf148930a5b21032` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.507570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde2a78e7e4c48ddbf148930a5b21032)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.508136 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1322/2656] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:23.509249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fe42-6909-44da-bbd6-491585e42779 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.509557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fe42-6909-44da-bbd6-491585e42779 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.509817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.509984 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693fe42-6909-44da-bbd6-491585e42779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.532010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9693fe42-6909-44da-bbd6-491585e42779 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:23.533250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9693fe42-6909-44da-bbd6-491585e42779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.549618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1323/2657] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:23.551286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693fe42-6909-44da-bbd6-491585e42779 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.562355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693fe42-6909-44da-bbd6-491585e42779 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.569008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde2a78e7e4c48ddbf148930a5b21032'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.569344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.570142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.570266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde2a78e7e4c48ddbf148930a5b21032'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.570402 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.570691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] PATH_INFO: `/v3/projects/4e84610eb86544e890e17b1e279722b0/users/c933f532808947aeaa13730bfe7c3611/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.570920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde2a78e7e4c48ddbf148930a5b21032'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.587997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde2a78e7e4c48ddbf148930a5b21032'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.588760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e84610eb86544e890e17b1e279722b0, user_id=c933f532808947aeaa13730bfe7c3611, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.591469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.602406 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde2a78e7e4c48ddbf148930a5b21032'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:23.609201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1324/2658] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:23 2022] PUT /identity/v3/projects/4e84610eb86544e890e17b1e279722b0/users/c933f532808947aeaa13730bfe7c3611/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:23.610083 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.613372 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.619655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1335/2659] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:23 2022] DELETE /identity/v3/users/bde2a78e7e4c48ddbf148930a5b21032 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:23.619655 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.620298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.712536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a75b0-9ba2-4f4b-be32-afddeb9b8380 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.714582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813d24-5113-4286-9692-1ddbd4daf51c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.717753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878a36-ef93-4744-b6c9-8b3446720ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.718589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878a36-ef93-4744-b6c9-8b3446720ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.719134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878a36-ef93-4744-b6c9-8b3446720ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.719535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878a36-ef93-4744-b6c9-8b3446720ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.719972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.720592 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.720745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74878a36-ef93-4744-b6c9-8b3446720ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.720897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.721137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.721928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:23.722237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.722759 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74878a36-ef93-4744-b6c9-8b3446720ff8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.723955 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.737594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1336/2660] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:23.739186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878a36-ef93-4744-b6c9-8b3446720ff8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.750061 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1325/2661] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:23.750765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.751287 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878a36-ef93-4744-b6c9-8b3446720ff8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.757438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e01b5c-3ffe-4838-893c-5ca1621bd2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.758610 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01b5c-3ffe-4838-893c-5ca1621bd2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.758968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01b5c-3ffe-4838-893c-5ca1621bd2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.759330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01b5c-3ffe-4838-893c-5ca1621bd2f1 admin admin] PATH_INFO: `/v3/projects/4e84610eb86544e890e17b1e279722b0/users/c933f532808947aeaa13730bfe7c3611/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.761829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e01b5c-3ffe-4838-893c-5ca1621bd2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e84610eb86544e890e17b1e279722b0, user_id=c933f532808947aeaa13730bfe7c3611, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.763727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecd100-5941-4895-88e6-ee31f305575c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.764583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e01b5c-3ffe-4838-893c-5ca1621bd2f1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.771946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd936e-c1f8-471e-942b-87f552ebc140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.772918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd936e-c1f8-471e-942b-87f552ebc140 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.773387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd936e-c1f8-471e-942b-87f552ebc140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.773868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd936e-c1f8-471e-942b-87f552ebc140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.774696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd936e-c1f8-471e-942b-87f552ebc140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.776941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd936e-c1f8-471e-942b-87f552ebc140 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.778293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1337/2662] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:23 2022] PUT /identity/v3/projects/4e84610eb86544e890e17b1e279722b0/users/c933f532808947aeaa13730bfe7c3611/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:23.790091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03626c-87a6-423c-87fb-6532759104cd None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.790368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03626c-87a6-423c-87fb-6532759104cd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.790626 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03626c-87a6-423c-87fb-6532759104cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.799463 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:23.817361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:23.821756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1326/2663] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:23 2022] POST /identity/v3/projects => generated 403 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:23.823039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd936e-c1f8-471e-942b-87f552ebc140 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.842304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-5a03626c-87a6-423c-87fb-6532759104cd None None] MFA Rules not processed for user `c933f532808947aeaa13730bfe7c3611`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:23.843559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5a03626c-87a6-423c-87fb-6532759104cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.903745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd936e-c1f8-471e-942b-87f552ebc140 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.909047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027ce36-a122-42e9-a5e0-885826ad5aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.909706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ce36-a122-42e9-a5e0-885826ad5aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.910000 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ce36-a122-42e9-a5e0-885826ad5aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.910279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ce36-a122-42e9-a5e0-885826ad5aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.910924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027ce36-a122-42e9-a5e0-885826ad5aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.913987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027ce36-a122-42e9-a5e0-885826ad5aa9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.934594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1338/2664] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:23.935273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03626c-87a6-423c-87fb-6532759104cd None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.936826 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5a03626c-87a6-423c-87fb-6532759104cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:23.944293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1327/2665] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:23 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:23.947681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027ce36-a122-42e9-a5e0-885826ad5aa9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.957123 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03626c-87a6-423c-87fb-6532759104cd None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.958494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027ce36-a122-42e9-a5e0-885826ad5aa9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:23.963896 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.964632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.964767 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:23.965576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.965576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.965812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:23.965954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:23.966070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.966310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] PATH_INFO: `/v3/projects/be794fb3962b4e3ca6fa8eecad7a2815` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:23.967713 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.967836 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be794fb3962b4e3ca6fa8eecad7a2815)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:23.969810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:23.983907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1328/2666] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:23.983907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:23.985656 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.057481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be794fb3962b4e3ca6fa8eecad7a2815', 'request_id': 'req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:24.062469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba2d2e-c68e-4305-aeec-73113dca48bf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.069186 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be794fb3962b4e3ca6fa8eecad7a2815', 'request_id': 'req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:24.076994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be794fb3962b4e3ca6fa8eecad7a2815', 'request_id': 'req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:24.094726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] The token cache is being invalidate because project be794fb3962b4e3ca6fa8eecad7a2815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:24.095246 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:24.101118 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:24.106216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1339/2667] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:23 2022] DELETE /identity/v3/projects/be794fb3962b4e3ca6fa8eecad7a2815 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:24.110231 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.113424 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.133795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b0e73-79db-4f69-b116-ae620392a34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.134614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0e73-79db-4f69-b116-ae620392a34d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.134995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0e73-79db-4f69-b116-ae620392a34d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.135287 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0e73-79db-4f69-b116-ae620392a34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.139377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-036b0e73-79db-4f69-b116-ae620392a34d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.209358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:24.235613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b0e73-79db-4f69-b116-ae620392a34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.237446 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b0e73-79db-4f69-b116-ae620392a34d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.239122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6036f-e08d-44cf-b26f-bb025c2d2b20 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.246044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def18367-c985-46ea-8cdf-75334dadde5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.246662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18367-c985-46ea-8cdf-75334dadde5b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.246962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18367-c985-46ea-8cdf-75334dadde5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.247197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18367-c985-46ea-8cdf-75334dadde5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.247846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def18367-c985-46ea-8cdf-75334dadde5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.249434 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1329/2668] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:24.250644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bed8a2-8bd5-4290-be73-7012018bd23f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.250988 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bed8a2-8bd5-4290-be73-7012018bd23f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.251373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bed8a2-8bd5-4290-be73-7012018bd23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.254269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def18367-c985-46ea-8cdf-75334dadde5b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.275880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-27bed8a2-8bd5-4290-be73-7012018bd23f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:24.277580 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1340/2669] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:24.277770 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-27bed8a2-8bd5-4290-be73-7012018bd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.285850 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def18367-c985-46ea-8cdf-75334dadde5b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.301894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1330/2670] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:24.304220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34882-5642-402e-96d1-1df913c22e20 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.304517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34882-5642-402e-96d1-1df913c22e20 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.304797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34882-5642-402e-96d1-1df913c22e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.310818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def18367-c985-46ea-8cdf-75334dadde5b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.326717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac313a-321c-4c27-9cfa-ead7fc59a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.327482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac313a-321c-4c27-9cfa-ead7fc59a0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.327844 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac313a-321c-4c27-9cfa-ead7fc59a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.328430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac313a-321c-4c27-9cfa-ead7fc59a0e1 admin admin] PATH_INFO: `/v3/projects/a1ae7beaff40409a895df177fe403bc4/users/2ff86c8eadf04fa69438a5a50bca9a7f/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.341174 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-84b34882-5642-402e-96d1-1df913c22e20 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:24.341800 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-84b34882-5642-402e-96d1-1df913c22e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.345629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:24.354824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac313a-321c-4c27-9cfa-ead7fc59a0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ae7beaff40409a895df177fe403bc4, user_id=2ff86c8eadf04fa69438a5a50bca9a7f, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.358218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1331/2671] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:24.362670 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34882-5642-402e-96d1-1df913c22e20 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.363798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac313a-321c-4c27-9cfa-ead7fc59a0e1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.387795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34882-5642-402e-96d1-1df913c22e20 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.394997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1341/2672] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:24 2022] PUT /identity/v3/projects/a1ae7beaff40409a895df177fe403bc4/users/2ff86c8eadf04fa69438a5a50bca9a7f/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:24.396825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95feba-8936-405f-b756-d2bf9c0f5885 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.397674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95feba-8936-405f-b756-d2bf9c0f5885 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.397674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95feba-8936-405f-b756-d2bf9c0f5885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.421066 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7c95feba-8936-405f-b756-d2bf9c0f5885 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:24.422460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7c95feba-8936-405f-b756-d2bf9c0f5885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.486436 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.487221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.487521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.488053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.488456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:24.488760 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.491395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.503734 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1332/2673] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:32:24.508386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.511199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.516375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1342/2674] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:24.518561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95feba-8936-405f-b756-d2bf9c0f5885 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.532371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95feba-8936-405f-b756-d2bf9c0f5885 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.539283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.540093 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.540371 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.540647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.541853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.544238 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.583926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1343/2675] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:24 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:24.585632 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.585884 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332899a-5ddc-480f-9ed3-4751075d472b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.587394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.643293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.643828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.644115 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.644392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.648298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:24.653553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5544879-55f6-4124-b4b8-58162132f6e5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.657405 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbac50-21c3-4dc7-87e2-5ddc709537c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.658328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbac50-21c3-4dc7-87e2-5ddc709537c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.658943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbac50-21c3-4dc7-87e2-5ddc709537c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.659446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbac50-21c3-4dc7-87e2-5ddc709537c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.685567 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:24.717355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.719124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.726684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbac50-21c3-4dc7-87e2-5ddc709537c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.728168 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbac50-21c3-4dc7-87e2-5ddc709537c1 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.729498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1333/2676] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:24.730194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.741426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1344/2677] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:24.741723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e13670-6004-488f-8349-b3583a2213d2 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.747853 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b783d1-29b4-456b-9d55-46270a784c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.748470 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b783d1-29b4-456b-9d55-46270a784c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.748753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b783d1-29b4-456b-9d55-46270a784c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.749067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b783d1-29b4-456b-9d55-46270a784c17 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.749684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b783d1-29b4-456b-9d55-46270a784c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.752756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b783d1-29b4-456b-9d55-46270a784c17 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.785746 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1334/2678] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:24 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:24.787111 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbac50-21c3-4dc7-87e2-5ddc709537c1 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.798551 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbac50-21c3-4dc7-87e2-5ddc709537c1 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.809442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047e173-4025-40d2-9c11-9b3958a05beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.810480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047e173-4025-40d2-9c11-9b3958a05beb admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.810879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047e173-4025-40d2-9c11-9b3958a05beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.811240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047e173-4025-40d2-9c11-9b3958a05beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.811978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047e173-4025-40d2-9c11-9b3958a05beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.813858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047e173-4025-40d2-9c11-9b3958a05beb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.827162 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1345/2679] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:24.831355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b783d1-29b4-456b-9d55-46270a784c17 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.844094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b783d1-29b4-456b-9d55-46270a784c17 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.849523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5c200-1a30-44df-a00d-73955f60a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.850571 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5c200-1a30-44df-a00d-73955f60a3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.850999 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5c200-1a30-44df-a00d-73955f60a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.851355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5c200-1a30-44df-a00d-73955f60a3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.853752 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5c200-1a30-44df-a00d-73955f60a3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.854056 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5c200-1a30-44df-a00d-73955f60a3c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.872728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047e173-4025-40d2-9c11-9b3958a05beb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:24.873217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1335/2680] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:24.887049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047e173-4025-40d2-9c11-9b3958a05beb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:24.892254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:24.892947 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.893952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.894155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] PATH_INFO: `/v3/projects/4ac127a2185140388115163cdb0b3e75/users/1672a7bfdff14b68b214015619989424/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.898345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:24.925648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac127a2185140388115163cdb0b3e75, user_id=1672a7bfdff14b68b214015619989424, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:24.931668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:24.958068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1346/2681] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:24 2022] PUT /identity/v3/projects/4ac127a2185140388115163cdb0b3e75/users/1672a7bfdff14b68b214015619989424/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:24.965474 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f576-f410-4304-95c6-de33aa381679 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:24.966317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f576-f410-4304-95c6-de33aa381679 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:24.966623 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f576-f410-4304-95c6-de33aa381679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:24.993158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ad32f576-f410-4304-95c6-de33aa381679 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:24.994721 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ad32f576-f410-4304-95c6-de33aa381679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:25.133484 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1336/2682] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:25.141990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:25.152772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:25.256056 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781ec1-b551-4b4a-94d6-f19f73feb04d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:25.262662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455f641-cbf2-4905-a594-415a3192a232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:25.263562 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f641-cbf2-4905-a594-415a3192a232 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:25.263880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f641-cbf2-4905-a594-415a3192a232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:25.264476 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f641-cbf2-4905-a594-415a3192a232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:25.277860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455f641-cbf2-4905-a594-415a3192a232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:25.279408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455f641-cbf2-4905-a594-415a3192a232 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:25.291473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1347/2683] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:32:25.837727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be6faf-49ac-40e6-ac26-364cf4c9f0cc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:25.839498 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be6faf-49ac-40e6-ac26-364cf4c9f0cc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:25.840291 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be6faf-49ac-40e6-ac26-364cf4c9f0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:25.882052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-50be6faf-49ac-40e6-ac26-364cf4c9f0cc None None] MFA Rules not processed for user `2ff86c8eadf04fa69438a5a50bca9a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:25.883629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50be6faf-49ac-40e6-ac26-364cf4c9f0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:25.979677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1337/2684] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:25.984430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455f641-cbf2-4905-a594-415a3192a232 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:25.997614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455f641-cbf2-4905-a594-415a3192a232 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:26.004547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfcec4-a42b-4a5e-a51a-e2b982725037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:26.005310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcec4-a42b-4a5e-a51a-e2b982725037 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:26.005617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcec4-a42b-4a5e-a51a-e2b982725037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:26.005893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcec4-a42b-4a5e-a51a-e2b982725037 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:26.006623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfcec4-a42b-4a5e-a51a-e2b982725037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:26.009505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfcec4-a42b-4a5e-a51a-e2b982725037 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:26.052876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1348/2685] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:25 2022] POST /identity/v3/projects => generated 405 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:26.056949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be6faf-49ac-40e6-ac26-364cf4c9f0cc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:26.075265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be6faf-49ac-40e6-ac26-364cf4c9f0cc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:26.122655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:26.172105 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f43b92-3945-4b69-9454-4e02c7f34b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:26.173377 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f43b92-3945-4b69-9454-4e02c7f34b6a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:26.173926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f43b92-3945-4b69-9454-4e02c7f34b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:26.174334 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f43b92-3945-4b69-9454-4e02c7f34b6a admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:26.175260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f43b92-3945-4b69-9454-4e02c7f34b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:26.178933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f43b92-3945-4b69-9454-4e02c7f34b6a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:26.221912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfcec4-a42b-4a5e-a51a-e2b982725037 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:26.230570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1338/2686] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:26 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:26.235036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfcec4-a42b-4a5e-a51a-e2b982725037 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:26.249642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a2860-6e9f-4707-baf6-c442f6dd6057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:26.251096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a2860-6e9f-4707-baf6-c442f6dd6057 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:26.251353 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a2860-6e9f-4707-baf6-c442f6dd6057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:26.251622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a2860-6e9f-4707-baf6-c442f6dd6057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:26.252733 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a2860-6e9f-4707-baf6-c442f6dd6057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:26.254873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a2860-6e9f-4707-baf6-c442f6dd6057 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:26.277086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1349/2687] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:26.279871 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f43b92-3945-4b69-9454-4e02c7f34b6a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:26.294461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f43b92-3945-4b69-9454-4e02c7f34b6a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:26.307351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68fd9-8d77-48ce-8652-249cefc61b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:26.308282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68fd9-8d77-48ce-8652-249cefc61b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:26.309023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68fd9-8d77-48ce-8652-249cefc61b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:26.309430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68fd9-8d77-48ce-8652-249cefc61b15 admin admin] PATH_INFO: `/v3/projects/43bfe60c834b49fdb76159d811a12798/users/f2d4d8f5c5964100b052b991e35556e0/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:26.330928 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68fd9-8d77-48ce-8652-249cefc61b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bfe60c834b49fdb76159d811a12798, user_id=f2d4d8f5c5964100b052b991e35556e0, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:26.339263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68fd9-8d77-48ce-8652-249cefc61b15 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:26.358615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1339/2688] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:26 2022] PUT /identity/v3/projects/43bfe60c834b49fdb76159d811a12798/users/f2d4d8f5c5964100b052b991e35556e0/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:26.362647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a2860-6e9f-4707-baf6-c442f6dd6057 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:26.375977 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a2860-6e9f-4707-baf6-c442f6dd6057 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:26.472009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:26.472009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:26.472009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:26.472009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:26.472730 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:26.474507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:26.486269 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1350/2689] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:26.493952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68fd9-8d77-48ce-8652-249cefc61b15 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:26.510563 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68fd9-8d77-48ce-8652-249cefc61b15 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:26.520054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee488bc-b33d-4ffa-b3f2-31f82c193e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:26.522945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee488bc-b33d-4ffa-b3f2-31f82c193e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:26.523861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee488bc-b33d-4ffa-b3f2-31f82c193e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:26.524246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee488bc-b33d-4ffa-b3f2-31f82c193e31 admin admin] PATH_INFO: `/v3/projects/43bfe60c834b49fdb76159d811a12798/users/f2d4d8f5c5964100b052b991e35556e0/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:26.528233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee488bc-b33d-4ffa-b3f2-31f82c193e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bfe60c834b49fdb76159d811a12798, user_id=f2d4d8f5c5964100b052b991e35556e0, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:26.531226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee488bc-b33d-4ffa-b3f2-31f82c193e31 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:26.550678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1340/2690] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:26 2022] PUT /identity/v3/projects/43bfe60c834b49fdb76159d811a12798/users/f2d4d8f5c5964100b052b991e35556e0/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:27.614647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:27.618288 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:27.640712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3b39-4ba0-4864-8107-7957f145b8d1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:27.717127 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:27.746833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:27.748024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:27.748461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:27.748930 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] PATH_INFO: `/v3/users/f028c3c2f17d4d0982068881cdf61e90` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:27.752084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f028c3c2f17d4d0982068881cdf61e90)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:27.758470 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:27.845970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece9f11-6671-49be-aad1-4d103c5caa42 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:27.846560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece9f11-6671-49be-aad1-4d103c5caa42 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:27.846560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece9f11-6671-49be-aad1-4d103c5caa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:27.862115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f028c3c2f17d4d0982068881cdf61e90'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:27.862796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f028c3c2f17d4d0982068881cdf61e90'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:27.863409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f028c3c2f17d4d0982068881cdf61e90'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:27.879124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f028c3c2f17d4d0982068881cdf61e90'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:27.879753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3ece9f11-6671-49be-aad1-4d103c5caa42 None None] MFA Rules not processed for user `f2d4d8f5c5964100b052b991e35556e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:27.881012 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ece9f11-6671-49be-aad1-4d103c5caa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:27.891274 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-e076e0e1-8595-4e8c-8ae9-93f7def5e6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f028c3c2f17d4d0982068881cdf61e90'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:27.908436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1351/2691] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:27 2022] DELETE /identity/v3/users/f028c3c2f17d4d0982068881cdf61e90 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:27.915075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08783-417e-46ee-86a7-f032bcace432 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:27.915509 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08783-417e-46ee-86a7-f032bcace432 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:27.915629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08783-417e-46ee-86a7-f032bcace432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:27.948387 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6ff08783-417e-46ee-86a7-f032bcace432 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:27.950002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6ff08783-417e-46ee-86a7-f032bcace432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:28.031015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1341/2692] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:28.062164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1352/2693] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:28.090337 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece9f11-6671-49be-aad1-4d103c5caa42 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:28.091971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ece9f11-6671-49be-aad1-4d103c5caa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:28.257455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece9f11-6671-49be-aad1-4d103c5caa42 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:28.328029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:28.393504 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2190-958e-4f6c-af97-33e4c0fd77bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:28.396429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2190-958e-4f6c-af97-33e4c0fd77bb service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:28.396765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2190-958e-4f6c-af97-33e4c0fd77bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:28.397079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2190-958e-4f6c-af97-33e4c0fd77bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:28.420771 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d2190-958e-4f6c-af97-33e4c0fd77bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:28.422802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d2190-958e-4f6c-af97-33e4c0fd77bb service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:28.439660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1342/2694] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:32:29.177384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff08783-417e-46ee-86a7-f032bcace432 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:29.179603 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6ff08783-417e-46ee-86a7-f032bcace432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:29.203469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff08783-417e-46ee-86a7-f032bcace432 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:29.211164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:29.212270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:29.213929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:29.214452 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] PATH_INFO: `/v3/projects/a9062e29ff8e4abab29b564116f5e147` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:29.216875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9062e29ff8e4abab29b564116f5e147)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:29.219440 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:29.284987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9062e29ff8e4abab29b564116f5e147', 'request_id': 'req-6144005f-4647-418b-bede-95c863dc52a2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.292234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9062e29ff8e4abab29b564116f5e147', 'request_id': 'req-6144005f-4647-418b-bede-95c863dc52a2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.304236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9062e29ff8e4abab29b564116f5e147', 'request_id': 'req-6144005f-4647-418b-bede-95c863dc52a2'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.306363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:29.329981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] The token cache is being invalidate because project a9062e29ff8e4abab29b564116f5e147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:29.330607 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.331790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.335526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1353/2695] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:29 2022] DELETE /identity/v3/projects/a9062e29ff8e4abab29b564116f5e147 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:29.340796 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2190-958e-4f6c-af97-33e4c0fd77bb service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:29.387870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2190-958e-4f6c-af97-33e4c0fd77bb service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:29.548226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:29.548935 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:29.549481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:29.549481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] PATH_INFO: `/v3/users/c933f532808947aeaa13730bfe7c3611` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:29.551461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c933f532808947aeaa13730bfe7c3611)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:29.553722 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:29.623111 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c933f532808947aeaa13730bfe7c3611'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.623909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c933f532808947aeaa13730bfe7c3611'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.636599 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c933f532808947aeaa13730bfe7c3611'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.659663 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c933f532808947aeaa13730bfe7c3611'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.673908 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f18e93cc-2b97-461c-a79e-72886324b909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c933f532808947aeaa13730bfe7c3611'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:29.681744 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1343/2696] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:29 2022] DELETE /identity/v3/users/c933f532808947aeaa13730bfe7c3611 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:30.028905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:30.030812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:30.050993 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144005f-4647-418b-bede-95c863dc52a2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:30.138766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:30.139533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.139812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.140088 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] PATH_INFO: `/v3/projects/4e84610eb86544e890e17b1e279722b0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.142189 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e84610eb86544e890e17b1e279722b0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:30.144409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:30.209315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e84610eb86544e890e17b1e279722b0', 'request_id': 'req-76e17de1-3b80-4c36-b4cb-894deaa2a42e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:30.216391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e84610eb86544e890e17b1e279722b0', 'request_id': 'req-76e17de1-3b80-4c36-b4cb-894deaa2a42e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:30.222617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e84610eb86544e890e17b1e279722b0', 'request_id': 'req-76e17de1-3b80-4c36-b4cb-894deaa2a42e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:30.240692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] The token cache is being invalidate because project 4e84610eb86544e890e17b1e279722b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:30.240980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:30.242620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-76e17de1-3b80-4c36-b4cb-894deaa2a42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:30.245075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1354/2697] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:30 2022] DELETE /identity/v3/projects/4e84610eb86544e890e17b1e279722b0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:30.250613 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef574c-4f7f-4570-a20b-39815d534c53 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.250993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef574c-4f7f-4570-a20b-39815d534c53 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.251275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef574c-4f7f-4570-a20b-39815d534c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.290602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-46ef574c-4f7f-4570-a20b-39815d534c53 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:30.291869 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-46ef574c-4f7f-4570-a20b-39815d534c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:30.346460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:30.385208 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1344/2698] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:30.392481 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070978c-9282-4624-b283-c58e4761194c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.392764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070978c-9282-4624-b283-c58e4761194c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.393034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070978c-9282-4624-b283-c58e4761194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.416891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-a070978c-9282-4624-b283-c58e4761194c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:30.418242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a070978c-9282-4624-b283-c58e4761194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:30.428320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1355/2699] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:30.432809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef574c-4f7f-4570-a20b-39815d534c53 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:30.445790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef574c-4f7f-4570-a20b-39815d534c53 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:30.453559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:30.453559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.453855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.454226 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.454889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:30.455198 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:30.457047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:30.470620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1345/2700] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:30.474852 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070978c-9282-4624-b283-c58e4761194c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:30.485290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070978c-9282-4624-b283-c58e4761194c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:30.490861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:30.491633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.492009 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.492361 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.493105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:30.495141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:30.530267 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1356/2701] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:30 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:30.534431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:30.561478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e42a6-cba1-4d13-931d-a4abb0d3f838 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:30.667647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:30.670124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:30.682745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac8e7a-a53c-4135-a29e-9e667b27ec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:30.683926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8e7a-a53c-4135-a29e-9e667b27ec88 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.684357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8e7a-a53c-4135-a29e-9e667b27ec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.684711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8e7a-a53c-4135-a29e-9e667b27ec88 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.685570 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac8e7a-a53c-4135-a29e-9e667b27ec88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:30.687680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac8e7a-a53c-4135-a29e-9e667b27ec88 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:30.730895 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1346/2702] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:30 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:30.733206 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac8e7a-a53c-4135-a29e-9e667b27ec88 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:30.749004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac8e7a-a53c-4135-a29e-9e667b27ec88 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:30.759139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930834e5-fca5-4592-ad99-bf508c5c7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:30.761468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930834e5-fca5-4592-ad99-bf508c5c7ece admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.762003 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930834e5-fca5-4592-ad99-bf508c5c7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.762344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930834e5-fca5-4592-ad99-bf508c5c7ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.763082 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930834e5-fca5-4592-ad99-bf508c5c7ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:30.765388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930834e5-fca5-4592-ad99-bf508c5c7ece admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:30.789997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1347/2703] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:30.804867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930834e5-fca5-4592-ad99-bf508c5c7ece admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:30.813774 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:30.825741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930834e5-fca5-4592-ad99-bf508c5c7ece admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:30.833841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542563e5-f6a2-47e7-a4bc-c12d968fad06 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:30.841521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c43c-85df-4a55-915d-5598a7a5da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:30.842564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c43c-85df-4a55-915d-5598a7a5da3d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.843043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c43c-85df-4a55-915d-5598a7a5da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.843820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:30.844373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c43c-85df-4a55-915d-5598a7a5da3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.844503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.844656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.844931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] PATH_INFO: `/v3/users/2ff86c8eadf04fa69438a5a50bca9a7f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.845832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3c43c-85df-4a55-915d-5598a7a5da3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:30.847870 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff86c8eadf04fa69438a5a50bca9a7f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:30.848655 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3c43c-85df-4a55-915d-5598a7a5da3d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:30.849875 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:30.871050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1348/2704] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:30.878508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c43c-85df-4a55-915d-5598a7a5da3d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:30.904139 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c43c-85df-4a55-915d-5598a7a5da3d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:30.913055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20135b29-4450-491d-9409-558049ea9031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:30.914548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135b29-4450-491d-9409-558049ea9031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:30.915280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135b29-4450-491d-9409-558049ea9031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:30.915859 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135b29-4450-491d-9409-558049ea9031 admin admin] PATH_INFO: `/v3/projects/facce5ecfbc843838ea0a5513c02ad90/users/91d2e622389b42128b7dd30a9412844a/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:30.949606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff86c8eadf04fa69438a5a50bca9a7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:30.950565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff86c8eadf04fa69438a5a50bca9a7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:30.951459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff86c8eadf04fa69438a5a50bca9a7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:30.968689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135b29-4450-491d-9409-558049ea9031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facce5ecfbc843838ea0a5513c02ad90, user_id=91d2e622389b42128b7dd30a9412844a, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:30.978025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135b29-4450-491d-9409-558049ea9031 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:31.001860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff86c8eadf04fa69438a5a50bca9a7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.023431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1349/2705] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:30 2022] PUT /identity/v3/projects/facce5ecfbc843838ea0a5513c02ad90/users/91d2e622389b42128b7dd30a9412844a/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:31.032117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff86c8eadf04fa69438a5a50bca9a7f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.046092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9250-bdc5-426d-8672-7ed22f62421a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:31.046383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9250-bdc5-426d-8672-7ed22f62421a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:31.047048 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9250-bdc5-426d-8672-7ed22f62421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:31.075122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1357/2706] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:30 2022] DELETE /identity/v3/users/2ff86c8eadf04fa69438a5a50bca9a7f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:31.108233 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2b5b9250-bdc5-426d-8672-7ed22f62421a None None] MFA Rules not processed for user `91d2e622389b42128b7dd30a9412844a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:31.109491 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b5b9250-bdc5-426d-8672-7ed22f62421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:31.249125 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1350/2707] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:31.259799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:31.262145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:31.372967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31123a-8221-4d8a-b5be-55ff40a875df admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:31.378078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d3374-9fb9-4147-8aab-7ceb3a2ef719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:31.385773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d3374-9fb9-4147-8aab-7ceb3a2ef719 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:31.386138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d3374-9fb9-4147-8aab-7ceb3a2ef719 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:31.386421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d3374-9fb9-4147-8aab-7ceb3a2ef719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:31.405934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d3374-9fb9-4147-8aab-7ceb3a2ef719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:31.408843 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d3374-9fb9-4147-8aab-7ceb3a2ef719 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:31.423923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1358/2708] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:31.441294 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9250-bdc5-426d-8672-7ed22f62421a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:31.442870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b5b9250-bdc5-426d-8672-7ed22f62421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:31.462539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:31.548421 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9250-bdc5-426d-8672-7ed22f62421a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:31.555485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:31.556165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:31.556447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:31.556728 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] PATH_INFO: `/v3/projects/a1ae7beaff40409a895df177fe403bc4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:31.558135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ae7beaff40409a895df177fe403bc4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:31.560587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:31.648748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ae7beaff40409a895df177fe403bc4', 'request_id': 'req-9c2a080c-6d1a-4cae-93be-385c7682af9d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.667758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ae7beaff40409a895df177fe403bc4', 'request_id': 'req-9c2a080c-6d1a-4cae-93be-385c7682af9d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.678403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ae7beaff40409a895df177fe403bc4', 'request_id': 'req-9c2a080c-6d1a-4cae-93be-385c7682af9d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.695396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] The token cache is being invalidate because project a1ae7beaff40409a895df177fe403bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:31.696302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.697578 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.705339 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d3374-9fb9-4147-8aab-7ceb3a2ef719 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:31.707367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1351/2709] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:31 2022] DELETE /identity/v3/projects/a1ae7beaff40409a895df177fe403bc4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:31.719413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d3374-9fb9-4147-8aab-7ceb3a2ef719 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:31.832091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:31.833454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:31.834210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:31.837872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] PATH_INFO: `/v3/users/f2d4d8f5c5964100b052b991e35556e0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:31.841912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d4d8f5c5964100b052b991e35556e0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:31.846832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:31.848459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:31.863575 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:31.871822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a080c-6d1a-4cae-93be-385c7682af9d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:31.879284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:31.879931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:31.880212 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:31.880488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] PATH_INFO: `/v3/users/8902eb02e5324b939c7b19df639c799b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:31.881671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8902eb02e5324b939c7b19df639c799b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:31.884220 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:31.884367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:31.952372 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d4d8f5c5964100b052b991e35556e0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.955491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d4d8f5c5964100b052b991e35556e0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.956482 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d4d8f5c5964100b052b991e35556e0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.977371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8902eb02e5324b939c7b19df639c799b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.978367 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8902eb02e5324b939c7b19df639c799b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.985891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d4d8f5c5964100b052b991e35556e0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:31.988612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8902eb02e5324b939c7b19df639c799b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.005866 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d4d8f5c5964100b052b991e35556e0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.006528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8902eb02e5324b939c7b19df639c799b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.023455 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da5aaffa-3828-482c-83ba-f243279b0232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8902eb02e5324b939c7b19df639c799b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.032237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1352/2710] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:31 2022] DELETE /identity/v3/users/8902eb02e5324b939c7b19df639c799b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:32.036684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1359/2711] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:31 2022] DELETE /identity/v3/users/f2d4d8f5c5964100b052b991e35556e0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:32.068591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e728d95-aecb-470b-aaa8-41a15092b7cd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.069327 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e728d95-aecb-470b-aaa8-41a15092b7cd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.074431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e728d95-aecb-470b-aaa8-41a15092b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.117737 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2e728d95-aecb-470b-aaa8-41a15092b7cd None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:32.119152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2e728d95-aecb-470b-aaa8-41a15092b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.124959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:32.218982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1353/2712] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:32.233035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:32.235389 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.309475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2763b-a5f2-429f-b828-bc33b7744bf0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.309941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2763b-a5f2-429f-b828-bc33b7744bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.310313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2763b-a5f2-429f-b828-bc33b7744bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.329888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ea51d-2c2c-4683-ace7-3d5788fddb30 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:32.339878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:32.343745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.344376 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.348929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.362376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-26a2763b-a5f2-429f-b828-bc33b7744bf0 None None] MFA Rules not processed for user `1672a7bfdff14b68b214015619989424`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:32.363386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26a2763b-a5f2-429f-b828-bc33b7744bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.370717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:32.372549 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:32.391527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1360/2713] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:32:32.392618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:32.394175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.413298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc69a-d08d-4d03-baa2-691edd45b27f service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:32.420247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:32.421486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.421796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.422089 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] PATH_INFO: `/v3/projects/43bfe60c834b49fdb76159d811a12798` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.423298 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bfe60c834b49fdb76159d811a12798)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:32.425459 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:32.454727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1354/2714] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:32.462523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2763b-a5f2-429f-b828-bc33b7744bf0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:32.469705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26a2763b-a5f2-429f-b828-bc33b7744bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.496259 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2763b-a5f2-429f-b828-bc33b7744bf0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:32.512064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bfe60c834b49fdb76159d811a12798', 'request_id': 'req-a537b37d-f941-48d3-b13d-94a06b9dbd30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.522561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bfe60c834b49fdb76159d811a12798', 'request_id': 'req-a537b37d-f941-48d3-b13d-94a06b9dbd30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.534812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bfe60c834b49fdb76159d811a12798', 'request_id': 'req-a537b37d-f941-48d3-b13d-94a06b9dbd30'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.566960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] The token cache is being invalidate because project 43bfe60c834b49fdb76159d811a12798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:32.567320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.569908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a537b37d-f941-48d3-b13d-94a06b9dbd30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.575392 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1361/2715] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:32 2022] DELETE /identity/v3/projects/43bfe60c834b49fdb76159d811a12798 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:32.580490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8729-3843-45ff-ad7b-b43db58282e0 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.580831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8729-3843-45ff-ad7b-b43db58282e0 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.581155 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8729-3843-45ff-ad7b-b43db58282e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.597099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:32.598406 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.599241 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.600078 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.600832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:32.606293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:32.627890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-827a8729-3843-45ff-ad7b-b43db58282e0 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:32.629644 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-827a8729-3843-45ff-ad7b-b43db58282e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.653362 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1362/2716] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:32.656001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03666c41-3972-4c97-83d7-a648c6766de5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.656301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03666c41-3972-4c97-83d7-a648c6766de5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.656659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03666c41-3972-4c97-83d7-a648c6766de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.668726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1355/2717] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:32 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:32.671376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:32.673268 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.691448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-03666c41-3972-4c97-83d7-a648c6766de5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:32.692668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-03666c41-3972-4c97-83d7-a648c6766de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.703158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:32.716055 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:32.781209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264c080-a96d-4fad-921f-a60eeb2f9ae1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:32.787026 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5bcef-f014-456b-84b1-c6231e60c7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:32.787679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5bcef-f014-456b-84b1-c6231e60c7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.787962 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5bcef-f014-456b-84b1-c6231e60c7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.788236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5bcef-f014-456b-84b1-c6231e60c7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.789422 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5bcef-f014-456b-84b1-c6231e60c7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:32.791441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5bcef-f014-456b-84b1-c6231e60c7a3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:32.800788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1363/2718] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:32.801813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03666c41-3972-4c97-83d7-a648c6766de5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:32.803515 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-03666c41-3972-4c97-83d7-a648c6766de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.820141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03666c41-3972-4c97-83d7-a648c6766de5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:32.824137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1356/2719] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:32 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:32.824137 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5bcef-f014-456b-84b1-c6231e60c7a3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:32.826103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:32.826745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.827144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.827417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] PATH_INFO: `/v3/projects/476b0352a2604c4f93ed63aa050a4942` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.828637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476b0352a2604c4f93ed63aa050a4942)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:32.830620 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:32.837625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5bcef-f014-456b-84b1-c6231e60c7a3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:32.843201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:32.844197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.844431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.844702 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.845700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:32.846153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:32.848478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:32.869743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1357/2720] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:32.874264 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:32.889612 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b14a4-1677-4f63-8947-2ba0a1c39128 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:32.904808 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476b0352a2604c4f93ed63aa050a4942', 'request_id': 'req-dde9821b-c34c-43f9-a2f9-06f321958873'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.914830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476b0352a2604c4f93ed63aa050a4942', 'request_id': 'req-dde9821b-c34c-43f9-a2f9-06f321958873'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.922385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476b0352a2604c4f93ed63aa050a4942', 'request_id': 'req-dde9821b-c34c-43f9-a2f9-06f321958873'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.939741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] The token cache is being invalidate because project 476b0352a2604c4f93ed63aa050a4942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:32.940300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.941138 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:32.949802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1364/2721] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:32 2022] DELETE /identity/v3/projects/476b0352a2604c4f93ed63aa050a4942 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:32.951039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:32.953764 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:32.979779 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:32.980762 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:32.981219 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:32.981894 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:32.982860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:32.984967 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.002412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1358/2722] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:33.003651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.005756 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:33.039217 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1be6f-631c-468d-8fd4-2ae4fa804e24 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.040081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9821b-c34c-43f9-a2f9-06f321958873 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.045614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819d41d-bdcd-4666-827d-3d541d3c95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.045848 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ef1c-afab-4073-b02a-2e04aa211b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.046252 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819d41d-bdcd-4666-827d-3d541d3c95f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.046533 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819d41d-bdcd-4666-827d-3d541d3c95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.046811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819d41d-bdcd-4666-827d-3d541d3c95f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.047246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ef1c-afab-4073-b02a-2e04aa211b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.047464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819d41d-bdcd-4666-827d-3d541d3c95f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.047851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ef1c-afab-4073-b02a-2e04aa211b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.048279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ef1c-afab-4073-b02a-2e04aa211b64 admin admin] PATH_INFO: `/v3/projects/83d2386cc78e4daeba8c982123217c20/users/31e0bdf2af504a10bf7f4beaff64bfef/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.049589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819d41d-bdcd-4666-827d-3d541d3c95f3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.074585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677ef1c-afab-4073-b02a-2e04aa211b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d2386cc78e4daeba8c982123217c20, user_id=31e0bdf2af504a10bf7f4beaff64bfef, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.079679 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677ef1c-afab-4073-b02a-2e04aa211b64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.104058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1365/2723] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:32 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:33.105530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1359/2724] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:33 2022] PUT /identity/v3/projects/83d2386cc78e4daeba8c982123217c20/users/31e0bdf2af504a10bf7f4beaff64bfef/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:33.108087 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819d41d-bdcd-4666-827d-3d541d3c95f3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.109645 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ef1c-afab-4073-b02a-2e04aa211b64 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.189419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:33.281361 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ef1c-afab-4073-b02a-2e04aa211b64 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.293663 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819d41d-bdcd-4666-827d-3d541d3c95f3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.301331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f90c-80e6-4ad5-a245-62262a6143c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.302522 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f90c-80e6-4ad5-a245-62262a6143c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.303004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f90c-80e6-4ad5-a245-62262a6143c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.303502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f90c-80e6-4ad5-a245-62262a6143c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.305625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3fb24-c0b7-46e2-93dc-398618903d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.305881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f90c-80e6-4ad5-a245-62262a6143c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.306535 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3fb24-c0b7-46e2-93dc-398618903d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.307062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3fb24-c0b7-46e2-93dc-398618903d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.307940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3fb24-c0b7-46e2-93dc-398618903d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.309502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f90c-80e6-4ad5-a245-62262a6143c2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.317812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3fb24-c0b7-46e2-93dc-398618903d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.325155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3fb24-c0b7-46e2-93dc-398618903d7c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.343358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1366/2725] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:33 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:33.344689 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1360/2726] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:33.345295 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f90c-80e6-4ad5-a245-62262a6143c2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.347029 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3fb24-c0b7-46e2-93dc-398618903d7c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.360429 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f90c-80e6-4ad5-a245-62262a6143c2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.364870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3fb24-c0b7-46e2-93dc-398618903d7c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.374345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c8754-21c1-4073-87cf-e95f7ff6f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.375062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8754-21c1-4073-87cf-e95f7ff6f10b admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.375312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8754-21c1-4073-87cf-e95f7ff6f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.377694 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8754-21c1-4073-87cf-e95f7ff6f10b admin admin] PATH_INFO: `/v3/projects/83d2386cc78e4daeba8c982123217c20/users/31e0bdf2af504a10bf7f4beaff64bfef/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.379870 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528768e-580b-4ad5-9cf2-568d8937411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.380281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c8754-21c1-4073-87cf-e95f7ff6f10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d2386cc78e4daeba8c982123217c20, user_id=31e0bdf2af504a10bf7f4beaff64bfef, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.380812 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528768e-580b-4ad5-9cf2-568d8937411a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.381216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528768e-580b-4ad5-9cf2-568d8937411a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.381626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528768e-580b-4ad5-9cf2-568d8937411a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.383498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c8754-21c1-4073-87cf-e95f7ff6f10b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.384499 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528768e-580b-4ad5-9cf2-568d8937411a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.386785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528768e-580b-4ad5-9cf2-568d8937411a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.396678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1367/2727] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:33 2022] PUT /identity/v3/projects/83d2386cc78e4daeba8c982123217c20/users/31e0bdf2af504a10bf7f4beaff64bfef/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:33.404010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:33.425020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c8754-21c1-4073-87cf-e95f7ff6f10b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.435868 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1361/2728] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:32:33.541366 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c8754-21c1-4073-87cf-e95f7ff6f10b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.546976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d133a4-5624-42f1-aea7-613eebcf6f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.547617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d133a4-5624-42f1-aea7-613eebcf6f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.547900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d133a4-5624-42f1-aea7-613eebcf6f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.548170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d133a4-5624-42f1-aea7-613eebcf6f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.548837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d133a4-5624-42f1-aea7-613eebcf6f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.550582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d133a4-5624-42f1-aea7-613eebcf6f1b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.563421 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1368/2729] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:32:33.569275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528768e-580b-4ad5-9cf2-568d8937411a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.582983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528768e-580b-4ad5-9cf2-568d8937411a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.593392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4af31-d597-4e7f-b9b7-1a66e7664978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.594476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4af31-d597-4e7f-b9b7-1a66e7664978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.594759 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4af31-d597-4e7f-b9b7-1a66e7664978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.595371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4af31-d597-4e7f-b9b7-1a66e7664978 admin admin] PATH_INFO: `/v3/projects/a47f2bc7cffd4b33b7f5154b8c034b4d/users/3c1a51f67bab4421b9465f3694f53721/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.635144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4af31-d597-4e7f-b9b7-1a66e7664978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47f2bc7cffd4b33b7f5154b8c034b4d, user_id=3c1a51f67bab4421b9465f3694f53721, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.638751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4af31-d597-4e7f-b9b7-1a66e7664978 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.667542 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1362/2730] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:33 2022] PUT /identity/v3/projects/a47f2bc7cffd4b33b7f5154b8c034b4d/users/3c1a51f67bab4421b9465f3694f53721/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:33.672254 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85ef6-1bc5-407f-9b76-9c4425e0b90d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.673785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85ef6-1bc5-407f-9b76-9c4425e0b90d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.674332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85ef6-1bc5-407f-9b76-9c4425e0b90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.724042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-98f85ef6-1bc5-407f-9b76-9c4425e0b90d None None] MFA Rules not processed for user `3c1a51f67bab4421b9465f3694f53721`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:33.725357 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-98f85ef6-1bc5-407f-9b76-9c4425e0b90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:33.827163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1369/2731] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:33.832202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4af31-d597-4e7f-b9b7-1a66e7664978 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.919101 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4af31-d597-4e7f-b9b7-1a66e7664978 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:33.924538 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824d32d-fccc-470a-8b19-c1f8c55b7590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:33.925093 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d32d-fccc-470a-8b19-c1f8c55b7590 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:33.925383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d32d-fccc-470a-8b19-c1f8c55b7590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:33.925696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d32d-fccc-470a-8b19-c1f8c55b7590 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:33.926362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824d32d-fccc-470a-8b19-c1f8c55b7590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:33.928301 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824d32d-fccc-470a-8b19-c1f8c55b7590 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:33.971166 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1363/2732] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:33 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:33.972803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f85ef6-1bc5-407f-9b76-9c4425e0b90d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:33.985200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f85ef6-1bc5-407f-9b76-9c4425e0b90d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:34.018236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:34.071344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a4113-2ef8-45f6-8976-89f6f20dda9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:34.072000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a4113-2ef8-45f6-8976-89f6f20dda9a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:34.072285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a4113-2ef8-45f6-8976-89f6f20dda9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:34.072564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a4113-2ef8-45f6-8976-89f6f20dda9a admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:34.073253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a4113-2ef8-45f6-8976-89f6f20dda9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:34.075253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a4113-2ef8-45f6-8976-89f6f20dda9a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:34.105722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1370/2733] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:33 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:34.108256 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824d32d-fccc-470a-8b19-c1f8c55b7590 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:34.119549 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824d32d-fccc-470a-8b19-c1f8c55b7590 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:34.125398 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576d34-dd5f-4bf6-8298-b69574e58a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:34.126067 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576d34-dd5f-4bf6-8298-b69574e58a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:34.126351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576d34-dd5f-4bf6-8298-b69574e58a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:34.126638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576d34-dd5f-4bf6-8298-b69574e58a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:34.127610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c576d34-dd5f-4bf6-8298-b69574e58a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:34.128947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c576d34-dd5f-4bf6-8298-b69574e58a04 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:34.143938 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1364/2734] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:34.149661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a4113-2ef8-45f6-8976-89f6f20dda9a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:34.168460 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a4113-2ef8-45f6-8976-89f6f20dda9a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:34.174140 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842b04e-178e-45ce-9a7c-d2aa93428b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:34.174951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b04e-178e-45ce-9a7c-d2aa93428b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:34.175299 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b04e-178e-45ce-9a7c-d2aa93428b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:34.175643 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b04e-178e-45ce-9a7c-d2aa93428b30 admin admin] PATH_INFO: `/v3/projects/1143fa315db6425486a5e9d36e311588/users/cb2a6a21327943e78abb02a6a60669b8/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:34.194352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842b04e-178e-45ce-9a7c-d2aa93428b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1143fa315db6425486a5e9d36e311588, user_id=cb2a6a21327943e78abb02a6a60669b8, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:34.198351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842b04e-178e-45ce-9a7c-d2aa93428b30 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:34.222825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1371/2735] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:34 2022] PUT /identity/v3/projects/1143fa315db6425486a5e9d36e311588/users/cb2a6a21327943e78abb02a6a60669b8/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:34.226893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576d34-dd5f-4bf6-8298-b69574e58a04 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:34.238521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576d34-dd5f-4bf6-8298-b69574e58a04 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:34.326952 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e20a3-6e9c-44b8-a79a-a71ce17ce0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:34.327708 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e20a3-6e9c-44b8-a79a-a71ce17ce0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:34.327992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e20a3-6e9c-44b8-a79a-a71ce17ce0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:34.328365 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e20a3-6e9c-44b8-a79a-a71ce17ce0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:34.329065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e20a3-6e9c-44b8-a79a-a71ce17ce0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:34.330731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e20a3-6e9c-44b8-a79a-a71ce17ce0f8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:34.349054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1365/2736] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:32:34.350195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842b04e-178e-45ce-9a7c-d2aa93428b30 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:34.364154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842b04e-178e-45ce-9a7c-d2aa93428b30 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:34.370303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:34.371151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:34.371505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:34.371876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] PATH_INFO: `/v3/projects/1143fa315db6425486a5e9d36e311588/users/cb2a6a21327943e78abb02a6a60669b8/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:34.374614 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1143fa315db6425486a5e9d36e311588, user_id=cb2a6a21327943e78abb02a6a60669b8, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:34.378165 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:34.395294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1372/2737] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:34 2022] PUT /identity/v3/projects/1143fa315db6425486a5e9d36e311588/users/cb2a6a21327943e78abb02a6a60669b8/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:34.409017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b52f-fbb6-4861-8e8a-c9a2e41b17cd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:34.409415 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b52f-fbb6-4861-8e8a-c9a2e41b17cd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:34.409795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b52f-fbb6-4861-8e8a-c9a2e41b17cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:34.448767 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ada5b52f-fbb6-4861-8e8a-c9a2e41b17cd None None] MFA Rules not processed for user `cb2a6a21327943e78abb02a6a60669b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:34.450173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ada5b52f-fbb6-4861-8e8a-c9a2e41b17cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:34.494231 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:34.553712 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1366/2738] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:34.566310 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:34.568055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:34.649402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce476d0a-d64d-468f-aa39-7ea61602f629 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:34.653668 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:34.654391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:34.654681 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:34.654949 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:34.668187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:34.669969 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:34.681892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1373/2739] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:34.805441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5b52f-fbb6-4861-8e8a-c9a2e41b17cd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:34.823183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5b52f-fbb6-4861-8e8a-c9a2e41b17cd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:34.839050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddd785-43e0-4799-9e5e-d55059ed895c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:34.839304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddd785-43e0-4799-9e5e-d55059ed895c service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:34.839411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddd785-43e0-4799-9e5e-d55059ed895c service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:34.839723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddd785-43e0-4799-9e5e-d55059ed895c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:34.958254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddd785-43e0-4799-9e5e-d55059ed895c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:34.960422 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddd785-43e0-4799-9e5e-d55059ed895c service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:34.983925 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1367/2740] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:37.881855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:37.884112 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:38.012002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb7ef3-a1d9-4e8a-ac53-9836c71f59e5 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:38.017109 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:38.017796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:38.018073 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:38.018416 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] PATH_INFO: `/v3/users/91d2e622389b42128b7dd30a9412844a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:38.019555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d2e622389b42128b7dd30a9412844a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:38.021504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:38.053446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:38.116462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d2e622389b42128b7dd30a9412844a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:38.119931 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d2e622389b42128b7dd30a9412844a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:38.121320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d2e622389b42128b7dd30a9412844a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:38.146264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d2e622389b42128b7dd30a9412844a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:38.161430 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d2e622389b42128b7dd30a9412844a'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:38.185851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1374/2741] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:37 2022] DELETE /identity/v3/users/91d2e622389b42128b7dd30a9412844a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:38.190054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c81c-c9a8-46f3-84f6-655459351302 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:38.190761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c81c-c9a8-46f3-84f6-655459351302 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:38.190761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c81c-c9a8-46f3-84f6-655459351302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:38.225521 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8f17c81c-c9a8-46f3-84f6-655459351302 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:38.226945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8f17c81c-c9a8-46f3-84f6-655459351302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:38.391468 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1368/2742] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:38.405924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:38.408752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:38.545841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50bb58-a97b-4991-9d1b-bb0739b1a311 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:38.552072 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c0346-d1ad-4312-8fc8-9ffeef49e5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:38.553050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0346-d1ad-4312-8fc8-9ffeef49e5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:38.553335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0346-d1ad-4312-8fc8-9ffeef49e5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:38.553997 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0346-d1ad-4312-8fc8-9ffeef49e5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:38.569256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c0346-d1ad-4312-8fc8-9ffeef49e5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:38.572120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c0346-d1ad-4312-8fc8-9ffeef49e5b7 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:38.585000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1375/2743] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:38.976630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c81c-c9a8-46f3-84f6-655459351302 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:38.979058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8f17c81c-c9a8-46f3-84f6-655459351302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:39.005876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c81c-c9a8-46f3-84f6-655459351302 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:39.018617 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:39.019445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.021437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.021798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] PATH_INFO: `/v3/projects/facce5ecfbc843838ea0a5513c02ad90` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.027084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=facce5ecfbc843838ea0a5513c02ad90)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:39.030949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:39.177413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facce5ecfbc843838ea0a5513c02ad90', 'request_id': 'req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:39.193820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facce5ecfbc843838ea0a5513c02ad90', 'request_id': 'req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:39.206899 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facce5ecfbc843838ea0a5513c02ad90', 'request_id': 'req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:39.208648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:39.233586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] The token cache is being invalidate because project facce5ecfbc843838ea0a5513c02ad90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:39.234497 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:39.235469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a85aba40-9a12-4439-b6b4-ec6c6b3ef945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:39.238512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1369/2744] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:38 2022] DELETE /identity/v3/projects/facce5ecfbc843838ea0a5513c02ad90 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:39.246271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7da40-f5c7-4fb0-829e-6000498be0a4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.247209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7da40-f5c7-4fb0-829e-6000498be0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.247646 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7da40-f5c7-4fb0-829e-6000498be0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.291507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ded7da40-f5c7-4fb0-829e-6000498be0a4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:39.292905 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ded7da40-f5c7-4fb0-829e-6000498be0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:39.315340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5e32-2595-43a9-b2ab-be797bba25cf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.315985 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5e32-2595-43a9-b2ab-be797bba25cf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.316505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed5e32-2595-43a9-b2ab-be797bba25cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.362765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-46ed5e32-2595-43a9-b2ab-be797bba25cf None None] MFA Rules not processed for user `31e0bdf2af504a10bf7f4beaff64bfef`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:39.364566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-46ed5e32-2595-43a9-b2ab-be797bba25cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:39.393808 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1376/2745] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:39.396938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2375f-75bb-4ee9-9f80-dc574582b403 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.397583 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2375f-75bb-4ee9-9f80-dc574582b403 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.398320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2375f-75bb-4ee9-9f80-dc574582b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.429457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-7cb2375f-75bb-4ee9-9f80-dc574582b403 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:39.431690 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-7cb2375f-75bb-4ee9-9f80-dc574582b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:39.444686 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1377/2746] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:39.450892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2375f-75bb-4ee9-9f80-dc574582b403 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:39.466501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2375f-75bb-4ee9-9f80-dc574582b403 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:39.472936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:39.473811 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.474529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.475011 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.475857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:39.476755 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:39.479932 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:39.504783 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1378/2747] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:39.511531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1370/2748] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:39.512523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:39.525053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ed07-566d-4c8a-81e5-3334553aa087 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:39.527195 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed5e32-2595-43a9-b2ab-be797bba25cf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:39.529265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-46ed5e32-2595-43a9-b2ab-be797bba25cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:39.533454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9bd97-38d4-4a3d-87db-08766232b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:39.534354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bd97-38d4-4a3d-87db-08766232b819 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.534865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bd97-38d4-4a3d-87db-08766232b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.535277 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bd97-38d4-4a3d-87db-08766232b819 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.536227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9bd97-38d4-4a3d-87db-08766232b819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:39.538472 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9bd97-38d4-4a3d-87db-08766232b819 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:39.568079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:39.590407 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1379/2749] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:39 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:39.594630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9bd97-38d4-4a3d-87db-08766232b819 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:39.635772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed5e32-2595-43a9-b2ab-be797bba25cf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:39.669736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9bd97-38d4-4a3d-87db-08766232b819 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:39.676438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7f162-e742-4461-b37a-f1a9d227d80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:39.677974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7f162-e742-4461-b37a-f1a9d227d80f admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.678420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7f162-e742-4461-b37a-f1a9d227d80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.678778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7f162-e742-4461-b37a-f1a9d227d80f admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.679442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7f162-e742-4461-b37a-f1a9d227d80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:39.682255 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7f162-e742-4461-b37a-f1a9d227d80f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:39.717071 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1380/2750] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:39 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:39.722179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7f162-e742-4461-b37a-f1a9d227d80f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:39.744946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7e896-bc9c-46a4-a211-9fd02a4b2e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:39.744946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e896-bc9c-46a4-a211-9fd02a4b2e63 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.744946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e896-bc9c-46a4-a211-9fd02a4b2e63 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.744946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e896-bc9c-46a4-a211-9fd02a4b2e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.745625 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7f162-e742-4461-b37a-f1a9d227d80f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:39.746956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3dd7e896-bc9c-46a4-a211-9fd02a4b2e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:39.750380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc6138-f2fe-41f1-8c64-0e45c25953d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:39.751170 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6138-f2fe-41f1-8c64-0e45c25953d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.751513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6138-f2fe-41f1-8c64-0e45c25953d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.751939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6138-f2fe-41f1-8c64-0e45c25953d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.752674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc6138-f2fe-41f1-8c64-0e45c25953d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:39.754400 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc6138-f2fe-41f1-8c64-0e45c25953d5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:39.764647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:39.771216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1381/2751] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:32:39.777477 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc6138-f2fe-41f1-8c64-0e45c25953d5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:39.796968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc6138-f2fe-41f1-8c64-0e45c25953d5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:39.804235 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a4374-e174-4285-84a3-5995bc191f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:39.804862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a4374-e174-4285-84a3-5995bc191f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.805797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a4374-e174-4285-84a3-5995bc191f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.806078 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a4374-e174-4285-84a3-5995bc191f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.806960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a4374-e174-4285-84a3-5995bc191f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:39.808748 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a4374-e174-4285-84a3-5995bc191f33 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:39.823760 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1382/2752] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:39.834344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a4374-e174-4285-84a3-5995bc191f33 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:39.852833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a4374-e174-4285-84a3-5995bc191f33 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:39.855754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7e896-bc9c-46a4-a211-9fd02a4b2e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:39.857796 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7e896-bc9c-46a4-a211-9fd02a4b2e63 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:39.866010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053238f-7674-424e-a78a-a09d3b64df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:39.866723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053238f-7674-424e-a78a-a09d3b64df1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.867236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053238f-7674-424e-a78a-a09d3b64df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.868266 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053238f-7674-424e-a78a-a09d3b64df1c admin admin] PATH_INFO: `/v3/projects/3da16b5e565e4450b5596b5b7eef55a3/users/52631b27a1c14a08a41a8d45d23aa577/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.871441 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1371/2753] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:39.896808 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053238f-7674-424e-a78a-a09d3b64df1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da16b5e565e4450b5596b5b7eef55a3, user_id=52631b27a1c14a08a41a8d45d23aa577, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:39.901447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053238f-7674-424e-a78a-a09d3b64df1c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:39.923703 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1383/2754] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:39 2022] PUT /identity/v3/projects/3da16b5e565e4450b5596b5b7eef55a3/users/52631b27a1c14a08a41a8d45d23aa577/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:39.936647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77bf08-ba33-4862-91f5-ae5b53db135e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:39.936940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77bf08-ba33-4862-91f5-ae5b53db135e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:39.937227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77bf08-ba33-4862-91f5-ae5b53db135e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:39.987675 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7d77bf08-ba33-4862-91f5-ae5b53db135e None None] MFA Rules not processed for user `52631b27a1c14a08a41a8d45d23aa577`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:39.988945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7d77bf08-ba33-4862-91f5-ae5b53db135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:40.082905 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1372/2755] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:40.087602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053238f-7674-424e-a78a-a09d3b64df1c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:40.195096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053238f-7674-424e-a78a-a09d3b64df1c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:40.201860 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b491aa-dc26-4c5e-b791-6236b8597591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:40.202721 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b491aa-dc26-4c5e-b791-6236b8597591 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:40.203001 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b491aa-dc26-4c5e-b791-6236b8597591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:40.203275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b491aa-dc26-4c5e-b791-6236b8597591 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:40.203951 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b491aa-dc26-4c5e-b791-6236b8597591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:40.205958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b491aa-dc26-4c5e-b791-6236b8597591 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:40.245723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1384/2756] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:40.250765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77bf08-ba33-4862-91f5-ae5b53db135e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:40.265016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77bf08-ba33-4862-91f5-ae5b53db135e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:40.360554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6558db-227a-4f2c-9055-ecbbf0657ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:40.360554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6558db-227a-4f2c-9055-ecbbf0657ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:40.360554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6558db-227a-4f2c-9055-ecbbf0657ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:40.360554 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6558db-227a-4f2c-9055-ecbbf0657ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:40.360904 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6558db-227a-4f2c-9055-ecbbf0657ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:40.361696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6558db-227a-4f2c-9055-ecbbf0657ec8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:40.387556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1373/2757] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:40 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:40.395998 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b491aa-dc26-4c5e-b791-6236b8597591 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:40.412209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b491aa-dc26-4c5e-b791-6236b8597591 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:40.417989 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b99562-1eea-4976-ad10-9f6f49e735e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:40.418388 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99562-1eea-4976-ad10-9f6f49e735e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:40.418666 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99562-1eea-4976-ad10-9f6f49e735e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:40.418943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99562-1eea-4976-ad10-9f6f49e735e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:40.419598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b99562-1eea-4976-ad10-9f6f49e735e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:40.421356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b99562-1eea-4976-ad10-9f6f49e735e3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:40.596803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1385/2758] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:40.598347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6558db-227a-4f2c-9055-ecbbf0657ec8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:40.614145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6558db-227a-4f2c-9055-ecbbf0657ec8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:40.622124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794ced7-476e-4368-9d22-387936f2610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:40.622753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ced7-476e-4368-9d22-387936f2610b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:40.623037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ced7-476e-4368-9d22-387936f2610b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:40.623313 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ced7-476e-4368-9d22-387936f2610b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:40.623982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794ced7-476e-4368-9d22-387936f2610b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:40.626236 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794ced7-476e-4368-9d22-387936f2610b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:40.637574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1374/2759] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:40.642696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b99562-1eea-4976-ad10-9f6f49e735e3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:40.655345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b99562-1eea-4976-ad10-9f6f49e735e3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:40.661058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e8e3-ed85-4db0-8c92-e5fcf4d1b006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:40.661778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e8e3-ed85-4db0-8c92-e5fcf4d1b006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:40.662052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e8e3-ed85-4db0-8c92-e5fcf4d1b006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:40.662317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e8e3-ed85-4db0-8c92-e5fcf4d1b006 admin admin] PATH_INFO: `/v3/projects/ff0efa5b00d2428b9817e490fcec1091/users/38f05633a01b40468ec6aad54e3e9f82/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:40.667350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:40.683841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573e8e3-ed85-4db0-8c92-e5fcf4d1b006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0efa5b00d2428b9817e490fcec1091, user_id=38f05633a01b40468ec6aad54e3e9f82, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:40.687160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573e8e3-ed85-4db0-8c92-e5fcf4d1b006 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:40.707713 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1386/2760] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:40 2022] PUT /identity/v3/projects/ff0efa5b00d2428b9817e490fcec1091/users/38f05633a01b40468ec6aad54e3e9f82/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:40.720699 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5866-999b-4e00-a48f-b48c0c0de548 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:40.721164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5866-999b-4e00-a48f-b48c0c0de548 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:40.721927 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b5866-999b-4e00-a48f-b48c0c0de548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:40.760293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a05b5866-999b-4e00-a48f-b48c0c0de548 None None] MFA Rules not processed for user `38f05633a01b40468ec6aad54e3e9f82`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:40.761772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a05b5866-999b-4e00-a48f-b48c0c0de548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:40.777856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:40.859027 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1375/2761] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:40.862856 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e8e3-ed85-4db0-8c92-e5fcf4d1b006 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:40.948023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e8e3-ed85-4db0-8c92-e5fcf4d1b006 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:40.955206 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91111-ffc7-4510-800e-68563cae387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:40.955966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91111-ffc7-4510-800e-68563cae387b admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:40.956320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91111-ffc7-4510-800e-68563cae387b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:40.957211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91111-ffc7-4510-800e-68563cae387b admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:40.957348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91111-ffc7-4510-800e-68563cae387b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:40.959426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91111-ffc7-4510-800e-68563cae387b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:41.014768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1387/2762] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:41.017191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b5866-999b-4e00-a48f-b48c0c0de548 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:41.031651 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b5866-999b-4e00-a48f-b48c0c0de548 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:41.131483 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d319c7-815f-44cc-a93a-3c1ecd2f1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:41.132106 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d319c7-815f-44cc-a93a-3c1ecd2f1e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:41.132396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d319c7-815f-44cc-a93a-3c1ecd2f1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:41.132677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d319c7-815f-44cc-a93a-3c1ecd2f1e5e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:41.133481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d319c7-815f-44cc-a93a-3c1ecd2f1e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:41.136229 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d319c7-815f-44cc-a93a-3c1ecd2f1e5e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:41.169996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1376/2763] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:41 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:32:41.170526 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91111-ffc7-4510-800e-68563cae387b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:41.185899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91111-ffc7-4510-800e-68563cae387b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:41.192166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef056259-6c64-4ee9-963c-d063a3044f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:41.192799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef056259-6c64-4ee9-963c-d063a3044f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:41.193080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef056259-6c64-4ee9-963c-d063a3044f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:41.193432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef056259-6c64-4ee9-963c-d063a3044f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:41.194052 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef056259-6c64-4ee9-963c-d063a3044f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:41.196914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef056259-6c64-4ee9-963c-d063a3044f6c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:41.212414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1388/2764] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:41.213931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d319c7-815f-44cc-a93a-3c1ecd2f1e5e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:41.226921 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d319c7-815f-44cc-a93a-3c1ecd2f1e5e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:41.234799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef27b1-083e-4fcd-a482-4c850d116f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:41.236575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef27b1-083e-4fcd-a482-4c850d116f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:41.236575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef27b1-083e-4fcd-a482-4c850d116f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:41.236795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef27b1-083e-4fcd-a482-4c850d116f96 admin admin] PATH_INFO: `/v3/projects/26eb0483c92f480b950c1309b252e123/users/33b626862fb34721a29041f237699f09/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:41.261469 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a19b-166b-4a8d-9079-82d192418ed1 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:41.262061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a19b-166b-4a8d-9079-82d192418ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:41.262328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a19b-166b-4a8d-9079-82d192418ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:41.264970 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef27b1-083e-4fcd-a482-4c850d116f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26eb0483c92f480b950c1309b252e123, user_id=33b626862fb34721a29041f237699f09, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:41.268409 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef27b1-083e-4fcd-a482-4c850d116f96 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:41.287709 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1377/2765] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:41 2022] PUT /identity/v3/projects/26eb0483c92f480b950c1309b252e123/users/33b626862fb34721a29041f237699f09/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:41.292202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef27b1-083e-4fcd-a482-4c850d116f96 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:41.292422 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-bb69a19b-166b-4a8d-9079-82d192418ed1 None None] MFA Rules not processed for user `1672a7bfdff14b68b214015619989424`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:41.293936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bb69a19b-166b-4a8d-9079-82d192418ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:41.372982 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef27b1-083e-4fcd-a482-4c850d116f96 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:41.382458 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11654534-65f7-4589-a585-63bf660f57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:41.382702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1389/2766] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:41.396005 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11654534-65f7-4589-a585-63bf660f57b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:41.398035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11654534-65f7-4589-a585-63bf660f57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:41.398035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11654534-65f7-4589-a585-63bf660f57b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:41.398035 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11654534-65f7-4589-a585-63bf660f57b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:41.399854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11654534-65f7-4589-a585-63bf660f57b4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:41.417194 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1378/2767] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:41.418442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69a19b-166b-4a8d-9079-82d192418ed1 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:41.434026 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69a19b-166b-4a8d-9079-82d192418ed1 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:41.441577 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:41.443101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:41.443101 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:41.443412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] PATH_INFO: `/v3/projects/26eb0483c92f480b950c1309b252e123/users/33b626862fb34721a29041f237699f09/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:41.445485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] RBAC: Authorizing `identity:create_grant(project_id=26eb0483c92f480b950c1309b252e123, user_id=33b626862fb34721a29041f237699f09, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:41.449151 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:41.461778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1390/2768] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:41 2022] PUT /identity/v3/projects/26eb0483c92f480b950c1309b252e123/users/33b626862fb34721a29041f237699f09/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:41.472661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38c459-8ae3-4896-b3b3-68b048e84b2d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:41.473020 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38c459-8ae3-4896-b3b3-68b048e84b2d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:41.473224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38c459-8ae3-4896-b3b3-68b048e84b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:41.508081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:41.521520 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e38c459-8ae3-4896-b3b3-68b048e84b2d None None] MFA Rules not processed for user `33b626862fb34721a29041f237699f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:41.522892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e38c459-8ae3-4896-b3b3-68b048e84b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:41.620832 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1379/2769] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:41.632584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:41.635059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:41.715585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7271-76c1-4392-a709-96bcf489bfab admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:41.726922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71001898-f79c-4bb3-bd62-593160a37a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:41.728341 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001898-f79c-4bb3-bd62-593160a37a32 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:41.728638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001898-f79c-4bb3-bd62-593160a37a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:41.728915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001898-f79c-4bb3-bd62-593160a37a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:41.734086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:41.822974 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71001898-f79c-4bb3-bd62-593160a37a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:41.824587 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71001898-f79c-4bb3-bd62-593160a37a32 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:41.835548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1391/2770] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:32:43.632356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38c459-8ae3-4896-b3b3-68b048e84b2d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:43.647993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38c459-8ae3-4896-b3b3-68b048e84b2d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:43.652741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bdb55-6278-4519-ab6b-63054075152a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:43.653395 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bdb55-6278-4519-ab6b-63054075152a service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:43.653804 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bdb55-6278-4519-ab6b-63054075152a service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:43.654081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bdb55-6278-4519-ab6b-63054075152a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:43.735165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bdb55-6278-4519-ab6b-63054075152a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:43.736633 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bdb55-6278-4519-ab6b-63054075152a service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:43.751902 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1380/2771] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:44.445103 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71001898-f79c-4bb3-bd62-593160a37a32 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:44.457630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71001898-f79c-4bb3-bd62-593160a37a32 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:44.458691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acda6f-dd52-45b8-b925-001b3d574fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:44.459300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acda6f-dd52-45b8-b925-001b3d574fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:44.459574 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acda6f-dd52-45b8-b925-001b3d574fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:44.459841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acda6f-dd52-45b8-b925-001b3d574fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:44.470090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acda6f-dd52-45b8-b925-001b3d574fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:44.471517 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acda6f-dd52-45b8-b925-001b3d574fb0 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:44.481921 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1392/2772] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:48.699745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bdb55-6278-4519-ab6b-63054075152a service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:48.772797 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bdb55-6278-4519-ab6b-63054075152a service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:48.777763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:48.778405 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:48.778691 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:48.778968 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] PATH_INFO: `/v3/users/52631b27a1c14a08a41a8d45d23aa577` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:48.780160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52631b27a1c14a08a41a8d45d23aa577)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:48.782130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:48.827545 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:48.848443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52631b27a1c14a08a41a8d45d23aa577'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:48.848443 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52631b27a1c14a08a41a8d45d23aa577'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:48.852071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52631b27a1c14a08a41a8d45d23aa577'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:48.866279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52631b27a1c14a08a41a8d45d23aa577'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:48.875517 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52631b27a1c14a08a41a8d45d23aa577'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:48.881566 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1381/2773] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:48 2022] DELETE /identity/v3/users/52631b27a1c14a08a41a8d45d23aa577 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:48.886301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7af9f-8dac-4417-ac16-e081c212ac76 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:48.886834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7af9f-8dac-4417-ac16-e081c212ac76 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:48.886834 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7af9f-8dac-4417-ac16-e081c212ac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:48.912137 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e2a7af9f-8dac-4417-ac16-e081c212ac76 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:48.913412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e2a7af9f-8dac-4417-ac16-e081c212ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:48.984090 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1393/2774] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:48.996059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:48.998127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:49.071650 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2fcd-51e5-48d2-9a8b-0806fcea8c6f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:49.075851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857600-4ad8-4df5-8b09-c3b54981a63d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:49.076477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857600-4ad8-4df5-8b09-c3b54981a63d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:49.076763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857600-4ad8-4df5-8b09-c3b54981a63d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:49.077039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857600-4ad8-4df5-8b09-c3b54981a63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:49.094972 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5857600-4ad8-4df5-8b09-c3b54981a63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:49.096433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5857600-4ad8-4df5-8b09-c3b54981a63d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:49.113620 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1382/2775] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:49.466689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7af9f-8dac-4417-ac16-e081c212ac76 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:49.473383 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e2a7af9f-8dac-4417-ac16-e081c212ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:49.506897 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7af9f-8dac-4417-ac16-e081c212ac76 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:49.513272 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:49.513967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:49.514243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:49.514520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] PATH_INFO: `/v3/projects/3da16b5e565e4450b5596b5b7eef55a3` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:49.517746 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da16b5e565e4450b5596b5b7eef55a3)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:49.521331 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:49.608359 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da16b5e565e4450b5596b5b7eef55a3', 'request_id': 'req-6d56047f-b3e0-4fed-8572-1cc53aedac85'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.614928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da16b5e565e4450b5596b5b7eef55a3', 'request_id': 'req-6d56047f-b3e0-4fed-8572-1cc53aedac85'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.622021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da16b5e565e4450b5596b5b7eef55a3', 'request_id': 'req-6d56047f-b3e0-4fed-8572-1cc53aedac85'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.653622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] The token cache is being invalidate because project 3da16b5e565e4450b5596b5b7eef55a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:49.654058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.654785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.656516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1394/2776] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:49 2022] DELETE /identity/v3/projects/3da16b5e565e4450b5596b5b7eef55a3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:49.661843 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857600-4ad8-4df5-8b09-c3b54981a63d service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:49.675045 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857600-4ad8-4df5-8b09-c3b54981a63d service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:49.745376 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:49.746133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:49.746400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:49.746808 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] PATH_INFO: `/v3/users/38f05633a01b40468ec6aad54e3e9f82` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:49.747911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f05633a01b40468ec6aad54e3e9f82)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:49.749941 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:49.803532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f05633a01b40468ec6aad54e3e9f82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.804113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f05633a01b40468ec6aad54e3e9f82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.812855 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f05633a01b40468ec6aad54e3e9f82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.819057 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:49.828924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f05633a01b40468ec6aad54e3e9f82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.836433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f05633a01b40468ec6aad54e3e9f82'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:49.842873 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1383/2777] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:49 2022] DELETE /identity/v3/users/38f05633a01b40468ec6aad54e3e9f82 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:50.148375 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:50.150207 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:50.174004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56047f-b3e0-4fed-8572-1cc53aedac85 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:50.188819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:50.240503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:50.241139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:50.241414 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:50.241723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] PATH_INFO: `/v3/projects/ff0efa5b00d2428b9817e490fcec1091` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:50.242888 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0efa5b00d2428b9817e490fcec1091)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:50.245462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:50.312390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0efa5b00d2428b9817e490fcec1091', 'request_id': 'req-5ec16cf3-471d-4579-94bb-1b50b56095a0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.319049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0efa5b00d2428b9817e490fcec1091', 'request_id': 'req-5ec16cf3-471d-4579-94bb-1b50b56095a0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.325049 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0efa5b00d2428b9817e490fcec1091', 'request_id': 'req-5ec16cf3-471d-4579-94bb-1b50b56095a0'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.341132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] The token cache is being invalidate because project ff0efa5b00d2428b9817e490fcec1091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:50.341444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.342163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.347900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1395/2778] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:50 2022] DELETE /identity/v3/projects/ff0efa5b00d2428b9817e490fcec1091 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:50.349309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:50.350880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:50.364416 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d263e-6ea8-48da-982e-3c9a9c331608 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:50.426320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:50.426963 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:50.427250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:50.427527 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] PATH_INFO: `/v3/users/33b626862fb34721a29041f237699f09` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:50.428669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b626862fb34721a29041f237699f09)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:50.430628 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:50.501389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b626862fb34721a29041f237699f09'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.502143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b626862fb34721a29041f237699f09'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.511094 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b626862fb34721a29041f237699f09'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.523909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b626862fb34721a29041f237699f09'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.532050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-408b655a-4efc-439d-aeb8-4bbd0c39c222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b626862fb34721a29041f237699f09'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:50.538330 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1384/2779] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:32:50 2022] DELETE /identity/v3/users/33b626862fb34721a29041f237699f09 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:50.892706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:50.894193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:50.907722 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16cf3-471d-4579-94bb-1b50b56095a0 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:50.975265 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:50.975915 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:50.976193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:50.976491 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] PATH_INFO: `/v3/projects/26eb0483c92f480b950c1309b252e123` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:50.977652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=26eb0483c92f480b950c1309b252e123)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:50.980945 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:51.042708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:51.044537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26eb0483c92f480b950c1309b252e123', 'request_id': 'req-1922da7e-9186-4912-9a76-e8b23957b0ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:51.055934 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26eb0483c92f480b950c1309b252e123', 'request_id': 'req-1922da7e-9186-4912-9a76-e8b23957b0ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:51.062861 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26eb0483c92f480b950c1309b252e123', 'request_id': 'req-1922da7e-9186-4912-9a76-e8b23957b0ed'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:51.076177 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] The token cache is being invalidate because project 26eb0483c92f480b950c1309b252e123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:32:51.076467 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:51.077117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-1922da7e-9186-4912-9a76-e8b23957b0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:32:51.078665 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1396/2780] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:32:50 2022] DELETE /identity/v3/projects/26eb0483c92f480b950c1309b252e123 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:32:51.083946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f9ffb-e7a1-4906-8dd3-6591bc76262f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.084488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f9ffb-e7a1-4906-8dd3-6591bc76262f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.084488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f9ffb-e7a1-4906-8dd3-6591bc76262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.108534 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d41f9ffb-e7a1-4906-8dd3-6591bc76262f None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:51.109835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d41f9ffb-e7a1-4906-8dd3-6591bc76262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:51.166685 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:51.178936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1385/2781] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:32:51.247899 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc464a8-72e8-4019-9e99-51e656c760cf None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.248992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc464a8-72e8-4019-9e99-51e656c760cf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.248992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc464a8-72e8-4019-9e99-51e656c760cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.269649 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-1fc464a8-72e8-4019-9e99-51e656c760cf None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:51.270880 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1fc464a8-72e8-4019-9e99-51e656c760cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:51.279346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1397/2782] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:51.288547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f9ffb-e7a1-4906-8dd3-6591bc76262f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:51.299897 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f9ffb-e7a1-4906-8dd3-6591bc76262f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:51.305678 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:51.306333 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.307422 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.308210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.308933 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:32:51.309289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:51.311445 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:51.324494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1386/2783] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:32:51.329091 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc464a8-72e8-4019-9e99-51e656c760cf None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:51.340541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc464a8-72e8-4019-9e99-51e656c760cf None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:51.345981 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20715cf4-f0a4-4bab-aba3-adc9044e6cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:51.346606 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20715cf4-f0a4-4bab-aba3-adc9044e6cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.346877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20715cf4-f0a4-4bab-aba3-adc9044e6cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.347146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20715cf4-f0a4-4bab-aba3-adc9044e6cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.347796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20715cf4-f0a4-4bab-aba3-adc9044e6cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:51.349726 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20715cf4-f0a4-4bab-aba3-adc9044e6cc9 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:51.380735 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1398/2784] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:32:51 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:51.384983 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:51.395667 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def0a12-74a2-4167-a33a-72eac217d06b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:51.466754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bbecc-e1b7-4700-ae66-153e0da14fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:51.467272 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bbecc-e1b7-4700-ae66-153e0da14fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.467548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bbecc-e1b7-4700-ae66-153e0da14fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.467977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bbecc-e1b7-4700-ae66-153e0da14fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.468630 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bbecc-e1b7-4700-ae66-153e0da14fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:51.470583 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bbecc-e1b7-4700-ae66-153e0da14fa7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:51.494374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1387/2785] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:32:51 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:32:51.499447 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20715cf4-f0a4-4bab-aba3-adc9044e6cc9 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:51.511075 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20715cf4-f0a4-4bab-aba3-adc9044e6cc9 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:51.517014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5b6cd-1c19-426c-b37d-d683791357c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:51.517653 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b6cd-1c19-426c-b37d-d683791357c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.517929 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b6cd-1c19-426c-b37d-d683791357c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.518195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b6cd-1c19-426c-b37d-d683791357c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.518838 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b6cd-1c19-426c-b37d-d683791357c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:51.520536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b6cd-1c19-426c-b37d-d683791357c2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:51.532818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1399/2786] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:51.537147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bbecc-e1b7-4700-ae66-153e0da14fa7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:51.548736 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bbecc-e1b7-4700-ae66-153e0da14fa7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:51.554355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f2d4-2be4-4994-9e4b-6d947c3b2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:51.555265 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f2d4-2be4-4994-9e4b-6d947c3b2cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.555659 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f2d4-2be4-4994-9e4b-6d947c3b2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.556063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f2d4-2be4-4994-9e4b-6d947c3b2cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.557717 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f2d4-2be4-4994-9e4b-6d947c3b2cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:51.559851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f2d4-2be4-4994-9e4b-6d947c3b2cc2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:51.575113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1388/2787] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:32:51.579326 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5b6cd-1c19-426c-b37d-d683791357c2 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:51.590236 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5b6cd-1c19-426c-b37d-d683791357c2 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:51.594980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:51.595648 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.595948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.596220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] PATH_INFO: `/v3/projects/150452f7d26849cebc81b37cc37d4686/users/b444ebc946f6496d91a962e5e1728a91/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.613302 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=150452f7d26849cebc81b37cc37d4686, user_id=b444ebc946f6496d91a962e5e1728a91, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:51.615983 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:51.630055 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1400/2788] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:32:51 2022] PUT /identity/v3/projects/150452f7d26849cebc81b37cc37d4686/users/b444ebc946f6496d91a962e5e1728a91/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:32:51.641978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224bb72-46b2-4237-847f-82054c7550fe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.642460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224bb72-46b2-4237-847f-82054c7550fe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.642839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224bb72-46b2-4237-847f-82054c7550fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.678352 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3224bb72-46b2-4237-847f-82054c7550fe None None] MFA Rules not processed for user `b444ebc946f6496d91a962e5e1728a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:51.678865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3224bb72-46b2-4237-847f-82054c7550fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:51.765479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1389/2789] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:51.776858 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:51.778695 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:51.843819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cbbc3-8def-4069-a2bc-44a31ebf29a8 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:51.847532 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:51.848153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:51.848426 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:51.848696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:51.858352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:51.859790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:51.869527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1401/2790] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:53.334757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374ddfb-bb44-40e3-807b-fe112dbffa6a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:53.335390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374ddfb-bb44-40e3-807b-fe112dbffa6a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:53.335390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374ddfb-bb44-40e3-807b-fe112dbffa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:53.357235 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7374ddfb-bb44-40e3-807b-fe112dbffa6a None None] MFA Rules not processed for user `b444ebc946f6496d91a962e5e1728a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:32:53.358518 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7374ddfb-bb44-40e3-807b-fe112dbffa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:53.367427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1390/2791] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:32:53.410775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:53.412557 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:53.484408 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24102088-b13d-4a60-b598-44f6b946f468 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:53.488217 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945f11bdc38e4728a78449d99a0fcbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:53.488832 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:53.489152 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:53.489427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:53.491315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:53.524564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:53.578498 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:53.579962 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:53.592559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1402/2792] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:32:54.130130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374ddfb-bb44-40e3-807b-fe112dbffa6a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:32:54.135892 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7374ddfb-bb44-40e3-807b-fe112dbffa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:54.202084 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:32:54.214807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374ddfb-bb44-40e3-807b-fe112dbffa6a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:32:54.220152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:32:54.220790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:32:54.221152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:32:54.221718 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:32:54.224314 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:32:54.242531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:32:54.243987 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:32:54.257033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1391/2793] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:03.586566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=20 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:04.252066 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:08.114631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:08.126183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87a23-fdb7-42d9-84a4-edc507b85414 service glance] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:08.129933 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe22e6-3d82-4050-abb2-251577100fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:08.130560 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe22e6-3d82-4050-abb2-251577100fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:08.133876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe22e6-3d82-4050-abb2-251577100fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:08.133876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe22e6-3d82-4050-abb2-251577100fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:08.133876 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-9afe22e6-3d82-4050-abb2-251577100fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:08.145245 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe22e6-3d82-4050-abb2-251577100fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:08.146737 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe22e6-3d82-4050-abb2-251577100fc6 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:08.156367 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1403/2794] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:08.338532 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:08.340850 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:08.439745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8866dc-cc67-4192-9162-7e6a8f8ad694 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:08.444940 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:08.445971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:08.446355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:08.446750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] PATH_INFO: `/v3/users/3c1a51f67bab4421b9465f3694f53721` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:08.448037 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1a51f67bab4421b9465f3694f53721)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:08.450172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:08.503007 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1a51f67bab4421b9465f3694f53721'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:08.503658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1a51f67bab4421b9465f3694f53721'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:08.511165 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1a51f67bab4421b9465f3694f53721'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:08.524344 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1a51f67bab4421b9465f3694f53721'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:08.532072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1a51f67bab4421b9465f3694f53721'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:08.538036 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1392/2795] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:08 2022] DELETE /identity/v3/users/3c1a51f67bab4421b9465f3694f53721 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:08.542541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653cb32-a0e9-43e2-92f0-7617973274f4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:08.542829 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653cb32-a0e9-43e2-92f0-7617973274f4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:08.543134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653cb32-a0e9-43e2-92f0-7617973274f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:08.563483 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c653cb32-a0e9-43e2-92f0-7617973274f4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:08.564959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c653cb32-a0e9-43e2-92f0-7617973274f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:08.627906 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1404/2796] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:08.638696 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:08.640148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:08.702018 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe690d-9264-49c7-8d88-5b75a83919b3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:08.705673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877aada-d7e4-403d-8339-aa52f11b5639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:08.706281 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877aada-d7e4-403d-8339-aa52f11b5639 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:08.706632 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877aada-d7e4-403d-8339-aa52f11b5639 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:08.706839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877aada-d7e4-403d-8339-aa52f11b5639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:08.717093 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877aada-d7e4-403d-8339-aa52f11b5639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:08.718616 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877aada-d7e4-403d-8339-aa52f11b5639 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:08.729472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1393/2797] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:09.014717 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653cb32-a0e9-43e2-92f0-7617973274f4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:09.016146 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c653cb32-a0e9-43e2-92f0-7617973274f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:09.030099 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653cb32-a0e9-43e2-92f0-7617973274f4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:09.035506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:09.036301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:09.036596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:09.036867 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] PATH_INFO: `/v3/projects/a47f2bc7cffd4b33b7f5154b8c034b4d` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:09.038033 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47f2bc7cffd4b33b7f5154b8c034b4d)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:09.040569 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:09.095538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47f2bc7cffd4b33b7f5154b8c034b4d', 'request_id': 'req-ef2c29e5-18d9-40f1-831b-6907c59fe98e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.103163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47f2bc7cffd4b33b7f5154b8c034b4d', 'request_id': 'req-ef2c29e5-18d9-40f1-831b-6907c59fe98e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.111413 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47f2bc7cffd4b33b7f5154b8c034b4d', 'request_id': 'req-ef2c29e5-18d9-40f1-831b-6907c59fe98e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.128900 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] The token cache is being invalidate because project a47f2bc7cffd4b33b7f5154b8c034b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:09.129822 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.130027 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.131521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1405/2798] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:09 2022] DELETE /identity/v3/projects/a47f2bc7cffd4b33b7f5154b8c034b4d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:33:09.135944 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877aada-d7e4-403d-8339-aa52f11b5639 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:09.146692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877aada-d7e4-403d-8339-aa52f11b5639 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:09.165937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:09.208107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:09.208658 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:09.208937 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:09.209216 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] PATH_INFO: `/v3/users/cb2a6a21327943e78abb02a6a60669b8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:09.210384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2a6a21327943e78abb02a6a60669b8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:09.212298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:09.260340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2a6a21327943e78abb02a6a60669b8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.261006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2a6a21327943e78abb02a6a60669b8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.269809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2a6a21327943e78abb02a6a60669b8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.283255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2a6a21327943e78abb02a6a60669b8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.290778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4c462c54-8794-4e10-b03f-9ef9a4278ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2a6a21327943e78abb02a6a60669b8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.297683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1394/2799] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:09 2022] DELETE /identity/v3/users/cb2a6a21327943e78abb02a6a60669b8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:09.710210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:09.711752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:09.726381 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c29e5-18d9-40f1-831b-6907c59fe98e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:09.789742 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:09.790402 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:09.790684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:09.790955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] PATH_INFO: `/v3/projects/1143fa315db6425486a5e9d36e311588` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:09.792107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1143fa315db6425486a5e9d36e311588)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:09.794281 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:09.806885 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:09.848024 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1143fa315db6425486a5e9d36e311588', 'request_id': 'req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.854380 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1143fa315db6425486a5e9d36e311588', 'request_id': 'req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.860242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1143fa315db6425486a5e9d36e311588', 'request_id': 'req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.878598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] The token cache is being invalidate because project 1143fa315db6425486a5e9d36e311588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:09.878909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.879548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5b4040e4-ff5b-4ed8-9de5-41cb87e99e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:09.881030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1406/2800] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:09 2022] DELETE /identity/v3/projects/1143fa315db6425486a5e9d36e311588 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:09.885947 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc28c0-5af6-4cc3-842f-7d3af0c72dcf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:09.886465 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc28c0-5af6-4cc3-842f-7d3af0c72dcf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:09.886575 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc28c0-5af6-4cc3-842f-7d3af0c72dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:09.907856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-27dc28c0-5af6-4cc3-842f-7d3af0c72dcf None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:09.909099 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-27dc28c0-5af6-4cc3-842f-7d3af0c72dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:09.972665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1395/2801] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:09.981787 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c619-6427-4ad7-8092-1372cde33d3d None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:09.981994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c619-6427-4ad7-8092-1372cde33d3d None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:09.982239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6c619-6427-4ad7-8092-1372cde33d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.003275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6eb6c619-6427-4ad7-8092-1372cde33d3d None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:10.004484 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6eb6c619-6427-4ad7-8092-1372cde33d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:10.013590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1407/2802] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:10.017958 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc28c0-5af6-4cc3-842f-7d3af0c72dcf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.028193 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc28c0-5af6-4cc3-842f-7d3af0c72dcf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.033117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.033782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.034112 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.034380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.035060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:33:10.035368 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.037054 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.049296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1396/2803] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:33:10.053892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6c619-6427-4ad7-8092-1372cde33d3d None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.063529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6c619-6427-4ad7-8092-1372cde33d3d None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.068225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9514023-2ff3-49ca-8d29-2672b1c8e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.068812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514023-2ff3-49ca-8d29-2672b1c8e589 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.069085 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514023-2ff3-49ca-8d29-2672b1c8e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.069351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514023-2ff3-49ca-8d29-2672b1c8e589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.070010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9514023-2ff3-49ca-8d29-2672b1c8e589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.071892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9514023-2ff3-49ca-8d29-2672b1c8e589 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.101046 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1408/2804] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:10 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:10.105250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.117550 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff87ae-05a6-45d6-a9bf-f70aee6006e0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.151289 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:10.189608 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdf146-651e-4f5f-be70-0cea3b066128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.190280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdf146-651e-4f5f-be70-0cea3b066128 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.190572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdf146-651e-4f5f-be70-0cea3b066128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.190846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdf146-651e-4f5f-be70-0cea3b066128 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.191479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdf146-651e-4f5f-be70-0cea3b066128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.193384 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdf146-651e-4f5f-be70-0cea3b066128 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.214805 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1397/2805] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:10 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:10.219059 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9514023-2ff3-49ca-8d29-2672b1c8e589 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.229761 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9514023-2ff3-49ca-8d29-2672b1c8e589 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.235199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d94753-767b-413c-817c-5f0d53c94d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.236369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94753-767b-413c-817c-5f0d53c94d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.236652 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94753-767b-413c-817c-5f0d53c94d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.236925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94753-767b-413c-817c-5f0d53c94d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.237590 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d94753-767b-413c-817c-5f0d53c94d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.239179 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d94753-767b-413c-817c-5f0d53c94d2e admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.250081 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1409/2806] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:33:10.254664 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdf146-651e-4f5f-be70-0cea3b066128 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.265015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdf146-651e-4f5f-be70-0cea3b066128 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.269742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc3032-ae40-4052-8d50-0a48eeb9ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.270353 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc3032-ae40-4052-8d50-0a48eeb9ccdc admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.270631 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc3032-ae40-4052-8d50-0a48eeb9ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.271016 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc3032-ae40-4052-8d50-0a48eeb9ccdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.271680 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc3032-ae40-4052-8d50-0a48eeb9ccdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.273345 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc3032-ae40-4052-8d50-0a48eeb9ccdc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.285839 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1398/2807] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:10.290294 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d94753-767b-413c-817c-5f0d53c94d2e admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.302253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d94753-767b-413c-817c-5f0d53c94d2e admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.307363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef63aa-c254-46dd-bd8d-d0890685775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.308126 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef63aa-c254-46dd-bd8d-d0890685775c admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.308461 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef63aa-c254-46dd-bd8d-d0890685775c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.308789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef63aa-c254-46dd-bd8d-d0890685775c admin admin] PATH_INFO: `/v3/projects/a9157d41780f40f4a2e3de09b8a4a569/users/cb17b939f4434d5f911ee9c00431cf5f/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.326164 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef63aa-c254-46dd-bd8d-d0890685775c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9157d41780f40f4a2e3de09b8a4a569, user_id=cb17b939f4434d5f911ee9c00431cf5f, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.328910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef63aa-c254-46dd-bd8d-d0890685775c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.344020 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1410/2808] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:10 2022] PUT /identity/v3/projects/a9157d41780f40f4a2e3de09b8a4a569/users/cb17b939f4434d5f911ee9c00431cf5f/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:10.354490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad9ec5-a202-4d7d-862d-146f5c966881 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.354889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad9ec5-a202-4d7d-862d-146f5c966881 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.355267 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad9ec5-a202-4d7d-862d-146f5c966881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.384840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18ad9ec5-a202-4d7d-862d-146f5c966881 None None] MFA Rules not processed for user `cb17b939f4434d5f911ee9c00431cf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:10.386172 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18ad9ec5-a202-4d7d-862d-146f5c966881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:10.453683 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1399/2809] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:10.458332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef63aa-c254-46dd-bd8d-d0890685775c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.522248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef63aa-c254-46dd-bd8d-d0890685775c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.526919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719717e8-b4f7-48a8-ab8b-e94acf04ce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.527529 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719717e8-b4f7-48a8-ab8b-e94acf04ce73 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.528464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719717e8-b4f7-48a8-ab8b-e94acf04ce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.529271 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719717e8-b4f7-48a8-ab8b-e94acf04ce73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.529499 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719717e8-b4f7-48a8-ab8b-e94acf04ce73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.531442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719717e8-b4f7-48a8-ab8b-e94acf04ce73 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.560757 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1411/2810] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:10 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:10.565221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad9ec5-a202-4d7d-862d-146f5c966881 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.578865 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad9ec5-a202-4d7d-862d-146f5c966881 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.638732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ca4ed-f186-49df-9d01-caf6fc7f4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.640442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ca4ed-f186-49df-9d01-caf6fc7f4690 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.640442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ca4ed-f186-49df-9d01-caf6fc7f4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.640442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ca4ed-f186-49df-9d01-caf6fc7f4690 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.640783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ca4ed-f186-49df-9d01-caf6fc7f4690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.642700 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ca4ed-f186-49df-9d01-caf6fc7f4690 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.673486 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1400/2811] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:10 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:10.675332 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719717e8-b4f7-48a8-ab8b-e94acf04ce73 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.694953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719717e8-b4f7-48a8-ab8b-e94acf04ce73 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.703248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089331cf-baab-43c3-a879-91359edd70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.704324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089331cf-baab-43c3-a879-91359edd70f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.704851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089331cf-baab-43c3-a879-91359edd70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.705527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089331cf-baab-43c3-a879-91359edd70f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.706913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089331cf-baab-43c3-a879-91359edd70f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.710268 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089331cf-baab-43c3-a879-91359edd70f3 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.735262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1412/2812] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:10.739242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ca4ed-f186-49df-9d01-caf6fc7f4690 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.753642 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ca4ed-f186-49df-9d01-caf6fc7f4690 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.761188 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06249741-cdd7-46f8-b053-627cedf835af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.762576 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06249741-cdd7-46f8-b053-627cedf835af admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.763053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06249741-cdd7-46f8-b053-627cedf835af admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.763609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06249741-cdd7-46f8-b053-627cedf835af admin admin] PATH_INFO: `/v3/projects/1fd6139bfdeb445e92a7ad407117d978/users/861c40fb7eeb4c738f1bc07ceaaba4ae/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.784263 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06249741-cdd7-46f8-b053-627cedf835af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd6139bfdeb445e92a7ad407117d978, user_id=861c40fb7eeb4c738f1bc07ceaaba4ae, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.787087 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06249741-cdd7-46f8-b053-627cedf835af admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.806254 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1401/2813] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:10 2022] PUT /identity/v3/projects/1fd6139bfdeb445e92a7ad407117d978/users/861c40fb7eeb4c738f1bc07ceaaba4ae/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:33:10.811354 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089331cf-baab-43c3-a879-91359edd70f3 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.826488 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089331cf-baab-43c3-a879-91359edd70f3 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.837200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:10.909749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b936c-1899-41e9-ac73-b8035cd97abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.910438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b936c-1899-41e9-ac73-b8035cd97abe admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.910938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b936c-1899-41e9-ac73-b8035cd97abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.911278 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b936c-1899-41e9-ac73-b8035cd97abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.911984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b936c-1899-41e9-ac73-b8035cd97abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.914007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b936c-1899-41e9-ac73-b8035cd97abe admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.933975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1413/2814] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:10.936374 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06249741-cdd7-46f8-b053-627cedf835af admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:10.943249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:10.953204 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06249741-cdd7-46f8-b053-627cedf835af admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:10.961555 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:10.961925 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.962205 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.962481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] PATH_INFO: `/v3/projects/1fd6139bfdeb445e92a7ad407117d978/users/861c40fb7eeb4c738f1bc07ceaaba4ae/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:10.964479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd6139bfdeb445e92a7ad407117d978, user_id=861c40fb7eeb4c738f1bc07ceaaba4ae, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:10.968160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:10.979273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1402/2815] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:10 2022] PUT /identity/v3/projects/1fd6139bfdeb445e92a7ad407117d978/users/861c40fb7eeb4c738f1bc07ceaaba4ae/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:10.989645 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0900-396e-4da5-a28d-25c411bb3edd None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:10.994104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0900-396e-4da5-a28d-25c411bb3edd None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:10.994104 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0900-396e-4da5-a28d-25c411bb3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:11.034623 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-fa3d0900-396e-4da5-a28d-25c411bb3edd None None] MFA Rules not processed for user `861c40fb7eeb4c738f1bc07ceaaba4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:11.035919 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-fa3d0900-396e-4da5-a28d-25c411bb3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:11.130848 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1414/2816] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:33:11.141304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:11.143100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:11.226013 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f71c6-b3a8-433c-8be0-4b7e0b107c6e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:11.234783 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417508e4-1bd5-4fe4-8feb-37afd9c53e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:11.235792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417508e4-1bd5-4fe4-8feb-37afd9c53e55 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:11.236081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417508e4-1bd5-4fe4-8feb-37afd9c53e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:11.236366 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417508e4-1bd5-4fe4-8feb-37afd9c53e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:11.247976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417508e4-1bd5-4fe4-8feb-37afd9c53e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:11.250363 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417508e4-1bd5-4fe4-8feb-37afd9c53e55 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:11.266876 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1403/2817] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:11.375232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0900-396e-4da5-a28d-25c411bb3edd None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:11.385492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0900-396e-4da5-a28d-25c411bb3edd None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:11.393153 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:11.393896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:11.394264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:11.394627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:11.474415 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:11.475777 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:11.486289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1415/2818] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:33:12.142244 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e64246-a339-42ac-8510-abf4ee0eef14 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:12.142829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e64246-a339-42ac-8510-abf4ee0eef14 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:12.142829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e64246-a339-42ac-8510-abf4ee0eef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:12.206199 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a2e64246-a339-42ac-8510-abf4ee0eef14 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:12.207351 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a2e64246-a339-42ac-8510-abf4ee0eef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:12.273742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1404/2819] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:12.330474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:12.331923 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:12.376813 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=100 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:12.453390 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a0f04-b224-42f0-ad8c-a7fd7a3b8523 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:12.462215 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82478eb-fc30-4964-82ac-d39c1d1621f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:12.462728 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82478eb-fc30-4964-82ac-d39c1d1621f8 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:12.463008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82478eb-fc30-4964-82ac-d39c1d1621f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:12.463279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82478eb-fc30-4964-82ac-d39c1d1621f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:12.473723 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82478eb-fc30-4964-82ac-d39c1d1621f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:12.475628 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82478eb-fc30-4964-82ac-d39c1d1621f8 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:12.489017 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1416/2820] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:33:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:33:13.227890 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106e1d-b47c-4162-b918-63b7c4148695 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:13.228394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106e1d-b47c-4162-b918-63b7c4148695 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:13.228669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106e1d-b47c-4162-b918-63b7c4148695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:13.261156 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-32106e1d-b47c-4162-b918-63b7c4148695 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:13.262778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32106e1d-b47c-4162-b918-63b7c4148695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:13.279862 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1405/2821] 10.222.0.15 () {58 vars in 967 bytes} [Thu Oct 6 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:13.294987 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82478eb-fc30-4964-82ac-d39c1d1621f8 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:13.307667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82478eb-fc30-4964-82ac-d39c1d1621f8 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:13.317871 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f04d-d17f-469a-af31-b027fcc07b44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:13.318506 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f04d-d17f-469a-af31-b027fcc07b44 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:13.318788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f04d-d17f-469a-af31-b027fcc07b44 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:13.319062 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f04d-d17f-469a-af31-b027fcc07b44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:13.336542 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972f04d-d17f-469a-af31-b027fcc07b44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:13.338276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972f04d-d17f-469a-af31-b027fcc07b44 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:13.355256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1417/2822] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:33:13.659255 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66828862-c472-42a9-bd37-6c4914baf5a9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:13.659544 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66828862-c472-42a9-bd37-6c4914baf5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:13.659844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66828862-c472-42a9-bd37-6c4914baf5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:13.680317 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-66828862-c472-42a9-bd37-6c4914baf5a9 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:13.681626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66828862-c472-42a9-bd37-6c4914baf5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:13.691461 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1406/2823] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Oct 6 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:13.704712 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f04d-d17f-469a-af31-b027fcc07b44 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:13.715702 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f04d-d17f-469a-af31-b027fcc07b44 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:13.721350 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9fcdc-45f2-4ab0-83a5-7ee02baeaf33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:13.721970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9fcdc-45f2-4ab0-83a5-7ee02baeaf33 service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:13.722280 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9fcdc-45f2-4ab0-83a5-7ee02baeaf33 service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:13.722553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9fcdc-45f2-4ab0-83a5-7ee02baeaf33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:13.732291 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9fcdc-45f2-4ab0-83a5-7ee02baeaf33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:13.733913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9fcdc-45f2-4ab0-83a5-7ee02baeaf33 service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:13.742927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1418/2824] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:33:14.111604 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881dec-de0d-47c7-b25f-024ab3288668 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:14.111891 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881dec-de0d-47c7-b25f-024ab3288668 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:14.112168 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881dec-de0d-47c7-b25f-024ab3288668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:14.135948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-30881dec-de0d-47c7-b25f-024ab3288668 None None] MFA Rules not processed for user `858b93ae249749b09d4a340668c3f970`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:14.137164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-30881dec-de0d-47c7-b25f-024ab3288668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:14.144788 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1407/2825] 10.222.0.15 () {58 vars in 967 bytes} [Thu Oct 6 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:14.157345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9fcdc-45f2-4ab0-83a5-7ee02baeaf33 service swift] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:14.170330 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9fcdc-45f2-4ab0-83a5-7ee02baeaf33 service swift] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:14.175878 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0370f-52e9-43e8-9f2b-8ce6c63ae3cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a2959940b40378234c1ae5e566c97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:14.176489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0370f-52e9-43e8-9f2b-8ce6c63ae3cf service swift] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:14.176766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0370f-52e9-43e8-9f2b-8ce6c63ae3cf service swift] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:14.177039 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0370f-52e9-43e8-9f2b-8ce6c63ae3cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:14.186818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0370f-52e9-43e8-9f2b-8ce6c63ae3cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:14.188618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0370f-52e9-43e8-9f2b-8ce6c63ae3cf service swift] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:14.197561 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1419/2826] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Oct 6 12:33:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 06 12:33:16.490922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30881dec-de0d-47c7-b25f-024ab3288668 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:16.492350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-30881dec-de0d-47c7-b25f-024ab3288668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:16.541634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:16.569435 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30881dec-de0d-47c7-b25f-024ab3288668 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:16.574945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:16.576649 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:16.576924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:16.577197 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] PATH_INFO: `/v3/users/b444ebc946f6496d91a962e5e1728a91` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:16.578420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b444ebc946f6496d91a962e5e1728a91)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:16.580329 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:16.636249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b444ebc946f6496d91a962e5e1728a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:16.637107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b444ebc946f6496d91a962e5e1728a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:16.647257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b444ebc946f6496d91a962e5e1728a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:16.661572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b444ebc946f6496d91a962e5e1728a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:16.671269 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b444ebc946f6496d91a962e5e1728a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:16.677835 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1408/2827] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:16 2022] DELETE /identity/v3/users/b444ebc946f6496d91a962e5e1728a91 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:16.683773 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0935a1-7e1a-48d9-886c-b733aec94936 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:16.684303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0935a1-7e1a-48d9-886c-b733aec94936 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:16.684303 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0935a1-7e1a-48d9-886c-b733aec94936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:16.707518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-8a0935a1-7e1a-48d9-886c-b733aec94936 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:16.708859 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8a0935a1-7e1a-48d9-886c-b733aec94936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:16.780257 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1420/2828] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:33:16.790148 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:16.791586 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:16.854387 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ad2e-057e-41c0-a789-4a09feb7eaaa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:16.858557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:16.859182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:16.859466 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:16.859738 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:16.875237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:16.876672 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:16.887392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1409/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:17.133913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0935a1-7e1a-48d9-886c-b733aec94936 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:17.135582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-8a0935a1-7e1a-48d9-886c-b733aec94936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:17.149622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0935a1-7e1a-48d9-886c-b733aec94936 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:17.155528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:17.156340 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:17.156883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:17.157216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] PATH_INFO: `/v3/projects/150452f7d26849cebc81b37cc37d4686` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:17.159351 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] RBAC: Authorizing `identity:delete_project(project_id=150452f7d26849cebc81b37cc37d4686)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:17.161914 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:17.227086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150452f7d26849cebc81b37cc37d4686', 'request_id': 'req-577bc3ca-f441-4c27-9893-2394da6a215d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:17.234502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150452f7d26849cebc81b37cc37d4686', 'request_id': 'req-577bc3ca-f441-4c27-9893-2394da6a215d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:17.237010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:17.242436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150452f7d26849cebc81b37cc37d4686', 'request_id': 'req-577bc3ca-f441-4c27-9893-2394da6a215d'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:17.261420 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] The token cache is being invalidate because project 150452f7d26849cebc81b37cc37d4686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:17.261758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:17.262412 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:17.264018 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1421/2830] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:17 2022] DELETE /identity/v3/projects/150452f7d26849cebc81b37cc37d4686 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:33:17.410072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:17.412306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:17.429910 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ac7f6-bd66-4b1e-a3a6-a37f9650a931 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:17.495058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15acd3-1edb-42a9-b1d6-3d6128240b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:17.496145 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15acd3-1edb-42a9-b1d6-3d6128240b98 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:17.496362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15acd3-1edb-42a9-b1d6-3d6128240b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:17.496695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15acd3-1edb-42a9-b1d6-3d6128240b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:17.499926 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be15acd3-1edb-42a9-b1d6-3d6128240b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:17.523824 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:17.583075 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15acd3-1edb-42a9-b1d6-3d6128240b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:17.584439 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15acd3-1edb-42a9-b1d6-3d6128240b98 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:17.596478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1410/2831] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:18.860107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:18.861911 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:18.942051 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc3ca-f441-4c27-9893-2394da6a215d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:18.946795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:18.947448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:18.947729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:18.948002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] PATH_INFO: `/v3/users/cb17b939f4434d5f911ee9c00431cf5f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:18.949209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb17b939f4434d5f911ee9c00431cf5f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:18.951886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:19.011892 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb17b939f4434d5f911ee9c00431cf5f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.012891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb17b939f4434d5f911ee9c00431cf5f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.013907 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb17b939f4434d5f911ee9c00431cf5f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.031736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb17b939f4434d5f911ee9c00431cf5f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.041234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb17b939f4434d5f911ee9c00431cf5f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.055567 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1422/2832] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:18 2022] DELETE /identity/v3/users/cb17b939f4434d5f911ee9c00431cf5f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:19.060564 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff581b-3611-4315-b8f7-ae58ce323ec3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:19.061090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff581b-3611-4315-b8f7-ae58ce323ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:19.061218 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff581b-3611-4315-b8f7-ae58ce323ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:19.086151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ccff581b-3611-4315-b8f7-ae58ce323ec3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:19.087956 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ccff581b-3611-4315-b8f7-ae58ce323ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:19.164803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1411/2833] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:19.176144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:19.177795 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:19.242530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23628-25c3-470d-944c-b29c1d0201fb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:19.246327 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022309-cfbc-48db-a5ee-6656774a1d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:19.246978 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022309-cfbc-48db-a5ee-6656774a1d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:19.247258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022309-cfbc-48db-a5ee-6656774a1d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:19.248105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022309-cfbc-48db-a5ee-6656774a1d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:19.258480 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7022309-cfbc-48db-a5ee-6656774a1d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:19.260453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7022309-cfbc-48db-a5ee-6656774a1d53 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:19.272035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1423/2834] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:33:19.626684 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff581b-3611-4315-b8f7-ae58ce323ec3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:19.628124 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ccff581b-3611-4315-b8f7-ae58ce323ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:19.642296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff581b-3611-4315-b8f7-ae58ce323ec3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:19.648310 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:19.649001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:19.649286 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:19.649741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] PATH_INFO: `/v3/projects/a9157d41780f40f4a2e3de09b8a4a569` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:19.650960 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9157d41780f40f4a2e3de09b8a4a569)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:19.652909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:19.726936 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9157d41780f40f4a2e3de09b8a4a569', 'request_id': 'req-435c7e23-4156-4b84-b6da-96115941dbb4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.742202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9157d41780f40f4a2e3de09b8a4a569', 'request_id': 'req-435c7e23-4156-4b84-b6da-96115941dbb4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.750778 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9157d41780f40f4a2e3de09b8a4a569', 'request_id': 'req-435c7e23-4156-4b84-b6da-96115941dbb4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.765169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] The token cache is being invalidate because project a9157d41780f40f4a2e3de09b8a4a569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:19.765638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.766799 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.771829 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1412/2835] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:19 2022] DELETE /identity/v3/projects/a9157d41780f40f4a2e3de09b8a4a569 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:19.773233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022309-cfbc-48db-a5ee-6656774a1d53 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:19.784243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022309-cfbc-48db-a5ee-6656774a1d53 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:19.788201 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:19.873436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:19.874768 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:19.875358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:19.875961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] PATH_INFO: `/v3/users/861c40fb7eeb4c738f1bc07ceaaba4ae` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:19.878253 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=861c40fb7eeb4c738f1bc07ceaaba4ae)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:19.882315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:19.969845 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861c40fb7eeb4c738f1bc07ceaaba4ae'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.970584 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861c40fb7eeb4c738f1bc07ceaaba4ae'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.971689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861c40fb7eeb4c738f1bc07ceaaba4ae'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:19.991765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861c40fb7eeb4c738f1bc07ceaaba4ae'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:20.004679 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a0261fce-b7ef-4dda-99f9-f82c02aa4c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861c40fb7eeb4c738f1bc07ceaaba4ae'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:20.028706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1424/2836] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:19 2022] DELETE /identity/v3/users/861c40fb7eeb4c738f1bc07ceaaba4ae => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:20.414531 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:20.416126 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:20.433019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7e23-4156-4b84-b6da-96115941dbb4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:20.485010 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:20.516284 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:20.516939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:20.517227 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:20.517505 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] PATH_INFO: `/v3/projects/1fd6139bfdeb445e92a7ad407117d978` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:20.518776 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd6139bfdeb445e92a7ad407117d978)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:20.520741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:20.584490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd6139bfdeb445e92a7ad407117d978', 'request_id': 'req-691e6b35-db23-4c8f-9045-d7f4296cebb2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:20.599634 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd6139bfdeb445e92a7ad407117d978', 'request_id': 'req-691e6b35-db23-4c8f-9045-d7f4296cebb2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:20.606275 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd6139bfdeb445e92a7ad407117d978', 'request_id': 'req-691e6b35-db23-4c8f-9045-d7f4296cebb2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:20.620598 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] The token cache is being invalidate because project 1fd6139bfdeb445e92a7ad407117d978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:20.620888 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:20.621560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-691e6b35-db23-4c8f-9045-d7f4296cebb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:20.623697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1413/2837] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:20 2022] DELETE /identity/v3/projects/1fd6139bfdeb445e92a7ad407117d978 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:20.628599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909179f1-f648-47a2-a833-9a78fbb0b9e5 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:20.628890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909179f1-f648-47a2-a833-9a78fbb0b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:20.629169 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909179f1-f648-47a2-a833-9a78fbb0b9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:20.651306 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-909179f1-f648-47a2-a833-9a78fbb0b9e5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:20.652637 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-909179f1-f648-47a2-a833-9a78fbb0b9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:20.721970 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1425/2838] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:20.729879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a1e7-1cc2-49db-882d-4ed98b503d7a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:20.730192 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a1e7-1cc2-49db-882d-4ed98b503d7a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:20.730462 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a1e7-1cc2-49db-882d-4ed98b503d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:20.753209 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fd98a1e7-1cc2-49db-882d-4ed98b503d7a None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:20.754490 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd98a1e7-1cc2-49db-882d-4ed98b503d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:20.762530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1414/2839] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:20.766840 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909179f1-f648-47a2-a833-9a78fbb0b9e5 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:20.777384 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909179f1-f648-47a2-a833-9a78fbb0b9e5 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:20.782873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:20.783520 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:20.783798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:20.784067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:20.789385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:33:20.789385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:20.789385 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:20.800256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1426/2840] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:33:20.804791 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98a1e7-1cc2-49db-882d-4ed98b503d7a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:20.815113 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98a1e7-1cc2-49db-882d-4ed98b503d7a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:20.819880 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b2f3b-304c-46d4-bb08-91d380fd4407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:20.820496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2f3b-304c-46d4-bb08-91d380fd4407 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:20.820777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2f3b-304c-46d4-bb08-91d380fd4407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:20.821053 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2f3b-304c-46d4-bb08-91d380fd4407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:20.821754 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b2f3b-304c-46d4-bb08-91d380fd4407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:20.823662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b2f3b-304c-46d4-bb08-91d380fd4407 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:20.858817 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1415/2841] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:20 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:20.863106 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:20.875395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94aa4-e897-4964-8278-ad0723079a7a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:20.884925 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:20.936868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dfd8b-489b-4851-baae-01108f5926be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:20.937486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dfd8b-489b-4851-baae-01108f5926be admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:20.937820 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dfd8b-489b-4851-baae-01108f5926be admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:20.938096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dfd8b-489b-4851-baae-01108f5926be admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:20.938747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dfd8b-489b-4851-baae-01108f5926be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:20.940771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dfd8b-489b-4851-baae-01108f5926be admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:20.964568 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1427/2842] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:20 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:20.968924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b2f3b-304c-46d4-bb08-91d380fd4407 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:20.979626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b2f3b-304c-46d4-bb08-91d380fd4407 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:20.985673 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb768d-402a-4f36-a801-beed1c5a74d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:20.986319 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb768d-402a-4f36-a801-beed1c5a74d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:20.986595 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb768d-402a-4f36-a801-beed1c5a74d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:20.986889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb768d-402a-4f36-a801-beed1c5a74d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:20.987560 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb768d-402a-4f36-a801-beed1c5a74d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:20.989320 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb768d-402a-4f36-a801-beed1c5a74d3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.000934 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1416/2843] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:21.005507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dfd8b-489b-4851-baae-01108f5926be admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.015940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dfd8b-489b-4851-baae-01108f5926be admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.021233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87ebb9-7ce1-4200-b61f-308033daa5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.021910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ebb9-7ce1-4200-b61f-308033daa5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.022191 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ebb9-7ce1-4200-b61f-308033daa5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.022464 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ebb9-7ce1-4200-b61f-308033daa5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.023116 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87ebb9-7ce1-4200-b61f-308033daa5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.024790 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87ebb9-7ce1-4200-b61f-308033daa5a2 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.038967 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1428/2844] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:21.042750 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb768d-402a-4f36-a801-beed1c5a74d3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.054062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb768d-402a-4f36-a801-beed1c5a74d3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.058889 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed46a3-7952-4e75-be01-e5b2a9fa230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.059690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed46a3-7952-4e75-be01-e5b2a9fa230c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.059893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed46a3-7952-4e75-be01-e5b2a9fa230c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.060202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed46a3-7952-4e75-be01-e5b2a9fa230c admin admin] PATH_INFO: `/v3/projects/58df0e4b7a5e442487a985c5ffaaa482/users/f5722f295af346838c17ae083fbfff54/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.075992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed46a3-7952-4e75-be01-e5b2a9fa230c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58df0e4b7a5e442487a985c5ffaaa482, user_id=f5722f295af346838c17ae083fbfff54, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.078727 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed46a3-7952-4e75-be01-e5b2a9fa230c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.095912 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1417/2845] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:21 2022] PUT /identity/v3/projects/58df0e4b7a5e442487a985c5ffaaa482/users/f5722f295af346838c17ae083fbfff54/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:21.108158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169217-f6ee-4b71-9fba-54ec31a1d56c None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.108369 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169217-f6ee-4b71-9fba-54ec31a1d56c None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.108618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169217-f6ee-4b71-9fba-54ec31a1d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.138613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-66169217-f6ee-4b71-9fba-54ec31a1d56c None None] MFA Rules not processed for user `f5722f295af346838c17ae083fbfff54`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:21.139939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-66169217-f6ee-4b71-9fba-54ec31a1d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:21.209837 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1429/2846] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:21.214772 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed46a3-7952-4e75-be01-e5b2a9fa230c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.280155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed46a3-7952-4e75-be01-e5b2a9fa230c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.284997 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52c606-64e8-4479-97d2-0d2c271b7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.285629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52c606-64e8-4479-97d2-0d2c271b7eca admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.285915 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52c606-64e8-4479-97d2-0d2c271b7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.286185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52c606-64e8-4479-97d2-0d2c271b7eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.286827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52c606-64e8-4479-97d2-0d2c271b7eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.288711 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52c606-64e8-4479-97d2-0d2c271b7eca admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.300825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:21.318262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1418/2847] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:21 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:21.322505 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66169217-f6ee-4b71-9fba-54ec31a1d56c None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.333846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66169217-f6ee-4b71-9fba-54ec31a1d56c None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.392074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e899-8b3a-41c8-85cb-e91efe5dbc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.392691 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e899-8b3a-41c8-85cb-e91efe5dbc30 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.392966 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e899-8b3a-41c8-85cb-e91efe5dbc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.393233 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e899-8b3a-41c8-85cb-e91efe5dbc30 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.393910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e899-8b3a-41c8-85cb-e91efe5dbc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.395824 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e899-8b3a-41c8-85cb-e91efe5dbc30 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.418068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1430/2848] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:21 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:21.422741 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52c606-64e8-4479-97d2-0d2c271b7eca admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.433494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52c606-64e8-4479-97d2-0d2c271b7eca admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.438202 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc5a61-8dcb-4542-b081-be8d249859ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.438810 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc5a61-8dcb-4542-b081-be8d249859ec admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.439155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc5a61-8dcb-4542-b081-be8d249859ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.439371 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc5a61-8dcb-4542-b081-be8d249859ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.440028 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc5a61-8dcb-4542-b081-be8d249859ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.441863 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc5a61-8dcb-4542-b081-be8d249859ec admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.455399 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1419/2849] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:21.459797 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e899-8b3a-41c8-85cb-e91efe5dbc30 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.471438 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e899-8b3a-41c8-85cb-e91efe5dbc30 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.476492 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5ffe5-918b-4d0e-aa61-a978350e6ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.481308 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5ffe5-918b-4d0e-aa61-a978350e6ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.481627 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5ffe5-918b-4d0e-aa61-a978350e6ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.481908 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5ffe5-918b-4d0e-aa61-a978350e6ded admin admin] PATH_INFO: `/v3/projects/21d78e93c3a0473cbd81125c6e6cc811/users/fd991cbab2f241ea9443a672f7b2d478/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.494270 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:21.501727 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5ffe5-918b-4d0e-aa61-a978350e6ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d78e93c3a0473cbd81125c6e6cc811, user_id=fd991cbab2f241ea9443a672f7b2d478, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.504830 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5ffe5-918b-4d0e-aa61-a978350e6ded admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.519240 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1431/2850] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:21 2022] PUT /identity/v3/projects/21d78e93c3a0473cbd81125c6e6cc811/users/fd991cbab2f241ea9443a672f7b2d478/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:21.523841 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc5a61-8dcb-4542-b081-be8d249859ec admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.536614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc5a61-8dcb-4542-b081-be8d249859ec admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.600606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaf7b8-32e5-4308-8f64-1273b855a4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.601610 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaf7b8-32e5-4308-8f64-1273b855a4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.602077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaf7b8-32e5-4308-8f64-1273b855a4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.602543 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaf7b8-32e5-4308-8f64-1273b855a4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.603582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaf7b8-32e5-4308-8f64-1273b855a4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.605496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaf7b8-32e5-4308-8f64-1273b855a4a1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.616360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1420/2851] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:21.620770 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5ffe5-918b-4d0e-aa61-a978350e6ded admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.631537 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5ffe5-918b-4d0e-aa61-a978350e6ded admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.636446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.637143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.637442 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.637741 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] PATH_INFO: `/v3/projects/21d78e93c3a0473cbd81125c6e6cc811/users/fd991cbab2f241ea9443a672f7b2d478/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.640175 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d78e93c3a0473cbd81125c6e6cc811, user_id=fd991cbab2f241ea9443a672f7b2d478, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.642935 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.653448 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1432/2852] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:21 2022] PUT /identity/v3/projects/21d78e93c3a0473cbd81125c6e6cc811/users/fd991cbab2f241ea9443a672f7b2d478/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:21.665609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe08d-93ff-47f2-9083-9fcf2002da4d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.665931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe08d-93ff-47f2-9083-9fcf2002da4d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.666213 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe08d-93ff-47f2-9083-9fcf2002da4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.696153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d5abe08d-93ff-47f2-9083-9fcf2002da4d None None] MFA Rules not processed for user `fd991cbab2f241ea9443a672f7b2d478`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:21.697392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d5abe08d-93ff-47f2-9083-9fcf2002da4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:21.774614 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1421/2853] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:21.790474 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.792937 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:21.861391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9369f-e6dc-44d7-8185-3858b7a55df1 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.865530 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a262a-c427-4192-8f66-a8b24de59072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.866289 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a262a-c427-4192-8f66-a8b24de59072 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.866629 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a262a-c427-4192-8f66-a8b24de59072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.866909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a262a-c427-4192-8f66-a8b24de59072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:21.878013 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a262a-c427-4192-8f66-a8b24de59072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:21.879478 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a262a-c427-4192-8f66-a8b24de59072 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:21.893979 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1433/2854] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:21.978306 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe08d-93ff-47f2-9083-9fcf2002da4d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:21.988790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe08d-93ff-47f2-9083-9fcf2002da4d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:21.992411 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c32e55-9e03-4eef-95b7-0392cbdf0802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:21.993019 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c32e55-9e03-4eef-95b7-0392cbdf0802 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:21.993311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c32e55-9e03-4eef-95b7-0392cbdf0802 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:21.993637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c32e55-9e03-4eef-95b7-0392cbdf0802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:22.054191 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c32e55-9e03-4eef-95b7-0392cbdf0802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:22.055671 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c32e55-9e03-4eef-95b7-0392cbdf0802 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:22.061023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:22.066293 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1422/2855] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:29.245076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a262a-c427-4192-8f66-a8b24de59072 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:29.311857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a262a-c427-4192-8f66-a8b24de59072 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:29.316912 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:29.317576 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:29.317857 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:29.318124 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] PATH_INFO: `/v3/users/f5722f295af346838c17ae083fbfff54` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:29.319250 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5722f295af346838c17ae083fbfff54)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:29.321171 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:29.370602 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5722f295af346838c17ae083fbfff54'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:29.371211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5722f295af346838c17ae083fbfff54'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:29.374548 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5722f295af346838c17ae083fbfff54'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:29.390659 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5722f295af346838c17ae083fbfff54'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:29.398320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5722f295af346838c17ae083fbfff54'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:29.403818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:29.418785 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1434/2856] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:29 2022] DELETE /identity/v3/users/f5722f295af346838c17ae083fbfff54 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:29.421851 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c509f-b3e6-41f0-b745-e1d2187136ab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:29.422677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c509f-b3e6-41f0-b745-e1d2187136ab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:29.422677 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c509f-b3e6-41f0-b745-e1d2187136ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:29.444380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-551c509f-b3e6-41f0-b745-e1d2187136ab None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:29.445652 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-551c509f-b3e6-41f0-b745-e1d2187136ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:29.510322 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1423/2857] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:29.521064 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:29.522493 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:29.586705 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b50e0-86c3-4719-adb1-7ef7f721e2c4 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:29.590573 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d5f3b-8f28-4ca2-be60-ff8bf0390184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:29.591197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d5f3b-8f28-4ca2-be60-ff8bf0390184 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:29.591473 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d5f3b-8f28-4ca2-be60-ff8bf0390184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:29.591745 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d5f3b-8f28-4ca2-be60-ff8bf0390184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:29.601881 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d5f3b-8f28-4ca2-be60-ff8bf0390184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:29.603314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d5f3b-8f28-4ca2-be60-ff8bf0390184 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:29.614345 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1435/2858] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:29.900996 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c509f-b3e6-41f0-b745-e1d2187136ab None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:29.902774 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-551c509f-b3e6-41f0-b745-e1d2187136ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:29.923648 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c509f-b3e6-41f0-b745-e1d2187136ab None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:29.930939 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:29.932023 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:29.932522 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:29.933015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] PATH_INFO: `/v3/projects/58df0e4b7a5e442487a985c5ffaaa482` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:29.935060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58df0e4b7a5e442487a985c5ffaaa482)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:29.938793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:29.999893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58df0e4b7a5e442487a985c5ffaaa482', 'request_id': 'req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.008358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58df0e4b7a5e442487a985c5ffaaa482', 'request_id': 'req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.014190 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58df0e4b7a5e442487a985c5ffaaa482', 'request_id': 'req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.025431 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] The token cache is being invalidate because project 58df0e4b7a5e442487a985c5ffaaa482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:30.025758 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.026390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.027907 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1424/2859] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:29 2022] DELETE /identity/v3/projects/58df0e4b7a5e442487a985c5ffaaa482 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:30.032953 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d5f3b-8f28-4ca2-be60-ff8bf0390184 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:30.044192 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d5f3b-8f28-4ca2-be60-ff8bf0390184 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:30.105810 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:30.106458 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:30.106739 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:30.107023 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] PATH_INFO: `/v3/users/fd991cbab2f241ea9443a672f7b2d478` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:30.108262 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd991cbab2f241ea9443a672f7b2d478)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:30.110264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:30.163903 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd991cbab2f241ea9443a672f7b2d478'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.164521 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd991cbab2f241ea9443a672f7b2d478'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.165211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd991cbab2f241ea9443a672f7b2d478'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.178042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd991cbab2f241ea9443a672f7b2d478'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.186225 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-5fc0ccf8-25bf-4c67-b524-748bbef9ff0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd991cbab2f241ea9443a672f7b2d478'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.199042 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1436/2860] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:30 2022] DELETE /identity/v3/users/fd991cbab2f241ea9443a672f7b2d478 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:30.494803 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:30.496276 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:30.511392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca1e31-4e1c-4f28-9cd6-01209b23c39f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:30.592058 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:30.593331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:30.593331 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:30.594072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] PATH_INFO: `/v3/projects/21d78e93c3a0473cbd81125c6e6cc811` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:30.595090 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d78e93c3a0473cbd81125c6e6cc811)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:30.597006 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:30.630516 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:30.649176 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d78e93c3a0473cbd81125c6e6cc811', 'request_id': 'req-57526ab1-88de-45e2-a928-1bcafe072c81'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.658714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d78e93c3a0473cbd81125c6e6cc811', 'request_id': 'req-57526ab1-88de-45e2-a928-1bcafe072c81'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.664989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d78e93c3a0473cbd81125c6e6cc811', 'request_id': 'req-57526ab1-88de-45e2-a928-1bcafe072c81'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.677420 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] The token cache is being invalidate because project 21d78e93c3a0473cbd81125c6e6cc811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:30.677681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.678307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-57526ab1-88de-45e2-a928-1bcafe072c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:30.679807 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1425/2861] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:30 2022] DELETE /identity/v3/projects/21d78e93c3a0473cbd81125c6e6cc811 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:30.685044 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a6210-5ff5-4cfa-922c-1a3d0017ecbc None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:30.685630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a6210-5ff5-4cfa-922c-1a3d0017ecbc None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:30.685630 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a6210-5ff5-4cfa-922c-1a3d0017ecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:30.706466 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ec5a6210-5ff5-4cfa-922c-1a3d0017ecbc None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:30.707680 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ec5a6210-5ff5-4cfa-922c-1a3d0017ecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:30.721060 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:30.776622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1437/2862] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:30.785155 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568291-21da-40f0-a9e2-7125565c20fd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:30.785442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568291-21da-40f0-a9e2-7125565c20fd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:30.785751 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568291-21da-40f0-a9e2-7125565c20fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:30.808123 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a2568291-21da-40f0-a9e2-7125565c20fd None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:30.809364 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a2568291-21da-40f0-a9e2-7125565c20fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:30.817660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1426/2863] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 06 12:33:30.821976 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a6210-5ff5-4cfa-922c-1a3d0017ecbc None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:30.832364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a6210-5ff5-4cfa-922c-1a3d0017ecbc None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:30.837038 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:30.837696 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:30.837980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:30.838247 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:30.838904 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:33:30.839208 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:30.840818 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:30.854030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1438/2864] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:33:30.858396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2568291-21da-40f0-a9e2-7125565c20fd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:30.872248 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2568291-21da-40f0-a9e2-7125565c20fd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:30.877379 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cd2f6-25f7-4156-861b-58899c9285fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:30.878024 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd2f6-25f7-4156-861b-58899c9285fa admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:30.878307 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd2f6-25f7-4156-861b-58899c9285fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:30.878582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd2f6-25f7-4156-861b-58899c9285fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:30.879228 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cd2f6-25f7-4156-861b-58899c9285fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:30.881121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cd2f6-25f7-4156-861b-58899c9285fa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:30.911184 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1427/2865] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:30 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:33:30.915220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:30.925803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ba46-794a-48a3-ac34-e9396836fbe5 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:30.985992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1bcc8-e4e7-44a5-bd29-45c52839b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:30.986511 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1bcc8-e4e7-44a5-bd29-45c52839b38a admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:30.986789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1bcc8-e4e7-44a5-bd29-45c52839b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:30.987061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1bcc8-e4e7-44a5-bd29-45c52839b38a admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:30.987692 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1bcc8-e4e7-44a5-bd29-45c52839b38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:30.989641 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1bcc8-e4e7-44a5-bd29-45c52839b38a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.018950 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1439/2866] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:30 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:31.023355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cd2f6-25f7-4156-861b-58899c9285fa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.034827 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cd2f6-25f7-4156-861b-58899c9285fa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.039607 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d9ca3-eeb0-43a4-9523-8f88a050040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.040260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d9ca3-eeb0-43a4-9523-8f88a050040a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.040540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d9ca3-eeb0-43a4-9523-8f88a050040a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.040811 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d9ca3-eeb0-43a4-9523-8f88a050040a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.041464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d9ca3-eeb0-43a4-9523-8f88a050040a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.043108 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d9ca3-eeb0-43a4-9523-8f88a050040a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.053732 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1428/2867] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:31.057869 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1bcc8-e4e7-44a5-bd29-45c52839b38a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.068528 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1bcc8-e4e7-44a5-bd29-45c52839b38a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.078132 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a7d41-e051-4ee2-a669-bf490a35af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.078758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7d41-e051-4ee2-a669-bf490a35af3d admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.079040 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7d41-e051-4ee2-a669-bf490a35af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.079307 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7d41-e051-4ee2-a669-bf490a35af3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.079960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a7d41-e051-4ee2-a669-bf490a35af3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.081581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a7d41-e051-4ee2-a669-bf490a35af3d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.093896 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1440/2868] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:31.098001 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d9ca3-eeb0-43a4-9523-8f88a050040a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.108336 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d9ca3-eeb0-43a4-9523-8f88a050040a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.113273 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca6955-aed2-430c-85c9-c4ad0e4c7b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.114033 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca6955-aed2-430c-85c9-c4ad0e4c7b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.114341 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca6955-aed2-430c-85c9-c4ad0e4c7b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.114615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca6955-aed2-430c-85c9-c4ad0e4c7b99 admin admin] PATH_INFO: `/v3/projects/207c5a1aa3e045eeaf295eb09f8debcd/users/4779f49416534125a44a53d31c004cab/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.131665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca6955-aed2-430c-85c9-c4ad0e4c7b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207c5a1aa3e045eeaf295eb09f8debcd, user_id=4779f49416534125a44a53d31c004cab, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.134380 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca6955-aed2-430c-85c9-c4ad0e4c7b99 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.149469 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1429/2869] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:31 2022] PUT /identity/v3/projects/207c5a1aa3e045eeaf295eb09f8debcd/users/4779f49416534125a44a53d31c004cab/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:31.160828 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac767c9-80d4-4e5c-bfe3-fdeb1555dfaa None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.161105 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac767c9-80d4-4e5c-bfe3-fdeb1555dfaa None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.161503 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac767c9-80d4-4e5c-bfe3-fdeb1555dfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.190747 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-dac767c9-80d4-4e5c-bfe3-fdeb1555dfaa None None] MFA Rules not processed for user `4779f49416534125a44a53d31c004cab`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:31.191959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-dac767c9-80d4-4e5c-bfe3-fdeb1555dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:31.271636 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1441/2870] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:31.279786 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca6955-aed2-430c-85c9-c4ad0e4c7b99 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.347692 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca6955-aed2-430c-85c9-c4ad0e4c7b99 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.352493 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f318e-a0b2-499e-a421-8c061de88f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.353131 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f318e-a0b2-499e-a421-8c061de88f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.353419 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f318e-a0b2-499e-a421-8c061de88f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.353733 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f318e-a0b2-499e-a421-8c061de88f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.354386 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f318e-a0b2-499e-a421-8c061de88f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.356298 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f318e-a0b2-499e-a421-8c061de88f03 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.384185 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1430/2871] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:31 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:31.388554 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac767c9-80d4-4e5c-bfe3-fdeb1555dfaa None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.402187 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac767c9-80d4-4e5c-bfe3-fdeb1555dfaa None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.412766 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:31.463994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30b3af-af96-4d16-a412-9fd4ac33b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.464592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b3af-af96-4d16-a412-9fd4ac33b2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.464872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b3af-af96-4d16-a412-9fd4ac33b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.465145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b3af-af96-4d16-a412-9fd4ac33b2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.465819 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30b3af-af96-4d16-a412-9fd4ac33b2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.468453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30b3af-af96-4d16-a412-9fd4ac33b2c6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.490427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1442/2872] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:31 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:31.494795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f318e-a0b2-499e-a421-8c061de88f03 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.506173 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f318e-a0b2-499e-a421-8c061de88f03 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.511303 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a663a1b-2b34-44e2-95a1-cb91318b023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.512225 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a663a1b-2b34-44e2-95a1-cb91318b023c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.512707 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a663a1b-2b34-44e2-95a1-cb91318b023c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.513144 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a663a1b-2b34-44e2-95a1-cb91318b023c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.514242 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a663a1b-2b34-44e2-95a1-cb91318b023c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.517802 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a663a1b-2b34-44e2-95a1-cb91318b023c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.532433 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1431/2873] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:31.536812 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30b3af-af96-4d16-a412-9fd4ac33b2c6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.547264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30b3af-af96-4d16-a412-9fd4ac33b2c6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.552209 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2460b4-1ab1-4087-a631-57737541a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.552879 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2460b4-1ab1-4087-a631-57737541a03d admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.553158 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2460b4-1ab1-4087-a631-57737541a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.553433 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2460b4-1ab1-4087-a631-57737541a03d admin admin] PATH_INFO: `/v3/projects/21383b5049b84777a7e56adfcff85487/users/9e07663f9bcf4b57957effc2eaa8ea6b/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.571816 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2460b4-1ab1-4087-a631-57737541a03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21383b5049b84777a7e56adfcff85487, user_id=9e07663f9bcf4b57957effc2eaa8ea6b, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.574558 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2460b4-1ab1-4087-a631-57737541a03d admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.588775 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1443/2874] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:31 2022] PUT /identity/v3/projects/21383b5049b84777a7e56adfcff85487/users/9e07663f9bcf4b57957effc2eaa8ea6b/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:31.593043 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a663a1b-2b34-44e2-95a1-cb91318b023c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.603237 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a663a1b-2b34-44e2-95a1-cb91318b023c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.625404 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:31.669452 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc8d5-1888-4385-a86d-ddfeb696d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.670107 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc8d5-1888-4385-a86d-ddfeb696d8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.670388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc8d5-1888-4385-a86d-ddfeb696d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.671196 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc8d5-1888-4385-a86d-ddfeb696d8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.671844 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc8d5-1888-4385-a86d-ddfeb696d8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.673438 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc8d5-1888-4385-a86d-ddfeb696d8d5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.684079 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1432/2875] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:31.690436 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2460b4-1ab1-4087-a631-57737541a03d admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.704684 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2460b4-1ab1-4087-a631-57737541a03d admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.709320 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.710021 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.710296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.710566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] PATH_INFO: `/v3/projects/21383b5049b84777a7e56adfcff85487/users/9e07663f9bcf4b57957effc2eaa8ea6b/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.712487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21383b5049b84777a7e56adfcff85487, user_id=9e07663f9bcf4b57957effc2eaa8ea6b, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:31.715154 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:31.725865 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1444/2876] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:31 2022] PUT /identity/v3/projects/21383b5049b84777a7e56adfcff85487/users/9e07663f9bcf4b57957effc2eaa8ea6b/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:31.795251 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393f52-27dd-4f70-b95a-6b5d1188a649 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.795453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393f52-27dd-4f70-b95a-6b5d1188a649 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.796350 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393f52-27dd-4f70-b95a-6b5d1188a649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:31.825993 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d9393f52-27dd-4f70-b95a-6b5d1188a649 None None] MFA Rules not processed for user `9e07663f9bcf4b57957effc2eaa8ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:31.827260 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d9393f52-27dd-4f70-b95a-6b5d1188a649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:31.904647 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1433/2877] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:31.917157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:31.918928 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:31.992731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638041be-713e-45f3-b6dc-8833234e061a admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:31.996596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d71062-fb0f-45e1-a1a6-88dceb8ded66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:31.997218 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d71062-fb0f-45e1-a1a6-88dceb8ded66 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:31.997500 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d71062-fb0f-45e1-a1a6-88dceb8ded66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:31.997803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d71062-fb0f-45e1-a1a6-88dceb8ded66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:32.008196 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d71062-fb0f-45e1-a1a6-88dceb8ded66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:32.009683 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d71062-fb0f-45e1-a1a6-88dceb8ded66 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:32.020368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1445/2878] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:32.073743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393f52-27dd-4f70-b95a-6b5d1188a649 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:32.075224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d9393f52-27dd-4f70-b95a-6b5d1188a649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:32.088250 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393f52-27dd-4f70-b95a-6b5d1188a649 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:32.091874 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea411c-6a63-41d5-8e31-61ae8adb9f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:32.093076 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea411c-6a63-41d5-8e31-61ae8adb9f88 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:32.093394 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea411c-6a63-41d5-8e31-61ae8adb9f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:32.093704 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea411c-6a63-41d5-8e31-61ae8adb9f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:32.157378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea411c-6a63-41d5-8e31-61ae8adb9f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:32.158854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea411c-6a63-41d5-8e31-61ae8adb9f88 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:32.167949 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1434/2879] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:35.563789 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d71062-fb0f-45e1-a1a6-88dceb8ded66 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:35.629243 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d71062-fb0f-45e1-a1a6-88dceb8ded66 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:35.633851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:35.634487 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:35.634765 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:35.635035 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] PATH_INFO: `/v3/users/4779f49416534125a44a53d31c004cab` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:35.636157 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4779f49416534125a44a53d31c004cab)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:35.638120 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:35.650346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:35.697239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4779f49416534125a44a53d31c004cab'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:35.698008 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4779f49416534125a44a53d31c004cab'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:35.698656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4779f49416534125a44a53d31c004cab'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:35.711613 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4779f49416534125a44a53d31c004cab'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:35.720067 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4779f49416534125a44a53d31c004cab'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:35.732749 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1446/2880] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:35 2022] DELETE /identity/v3/users/4779f49416534125a44a53d31c004cab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:35.738072 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a793d9-5faa-47e7-86b8-3450c44eebe5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:35.738606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a793d9-5faa-47e7-86b8-3450c44eebe5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:35.738743 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a793d9-5faa-47e7-86b8-3450c44eebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:35.760257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-74a793d9-5faa-47e7-86b8-3450c44eebe5 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:35.761479 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74a793d9-5faa-47e7-86b8-3450c44eebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:35.804234 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:35.824142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1435/2881] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:35.834513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:35.841582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:35.900029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c47b9f-48c5-4dc9-86bf-608a58ae8807 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:35.903593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab0936-9d2b-40f6-819f-c28b6f27f5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:35.904211 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0936-9d2b-40f6-819f-c28b6f27f5cd service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:35.904489 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0936-9d2b-40f6-819f-c28b6f27f5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:35.904788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0936-9d2b-40f6-819f-c28b6f27f5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:35.915007 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab0936-9d2b-40f6-819f-c28b6f27f5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:35.916444 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab0936-9d2b-40f6-819f-c28b6f27f5cd service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:35.927025 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1447/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:33:36.232401 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a793d9-5faa-47e7-86b8-3450c44eebe5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:36.234740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74a793d9-5faa-47e7-86b8-3450c44eebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:36.248918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a793d9-5faa-47e7-86b8-3450c44eebe5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:36.254417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:36.255073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:36.255358 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:36.255639 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] PATH_INFO: `/v3/projects/207c5a1aa3e045eeaf295eb09f8debcd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:36.256798 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] RBAC: Authorizing `identity:delete_project(project_id=207c5a1aa3e045eeaf295eb09f8debcd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:36.258765 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:36.312753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207c5a1aa3e045eeaf295eb09f8debcd', 'request_id': 'req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.320605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207c5a1aa3e045eeaf295eb09f8debcd', 'request_id': 'req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.326849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207c5a1aa3e045eeaf295eb09f8debcd', 'request_id': 'req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.338597 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] The token cache is being invalidate because project 207c5a1aa3e045eeaf295eb09f8debcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:36.338886 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.339547 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.341070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1436/2883] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:36 2022] DELETE /identity/v3/projects/207c5a1aa3e045eeaf295eb09f8debcd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:36.345936 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab0936-9d2b-40f6-819f-c28b6f27f5cd service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:36.357239 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab0936-9d2b-40f6-819f-c28b6f27f5cd service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:36.417961 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:36.418601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:36.418877 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:36.419150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] PATH_INFO: `/v3/users/9e07663f9bcf4b57957effc2eaa8ea6b` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:36.420286 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e07663f9bcf4b57957effc2eaa8ea6b)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:36.422938 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:36.459872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:36.474566 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e07663f9bcf4b57957effc2eaa8ea6b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.475264 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e07663f9bcf4b57957effc2eaa8ea6b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.475883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e07663f9bcf4b57957effc2eaa8ea6b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.489148 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e07663f9bcf4b57957effc2eaa8ea6b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.497378 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8aeaee50-7612-4fce-8179-bf72b345c674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e07663f9bcf4b57957effc2eaa8ea6b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.514141 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1448/2884] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:36 2022] DELETE /identity/v3/users/9e07663f9bcf4b57957effc2eaa8ea6b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:36.815257 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:36.816825 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:36.841397 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b1ea0-0ff5-4af8-b28b-8a08bf06852f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:36.911182 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:36.911860 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:36.912142 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:36.912417 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] PATH_INFO: `/v3/projects/21383b5049b84777a7e56adfcff85487` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:36.913627 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21383b5049b84777a7e56adfcff85487)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:36.915574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:36.963959 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21383b5049b84777a7e56adfcff85487', 'request_id': 'req-1db85951-ccb2-46bb-a42f-4f92e728d41b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.972111 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21383b5049b84777a7e56adfcff85487', 'request_id': 'req-1db85951-ccb2-46bb-a42f-4f92e728d41b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.978127 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21383b5049b84777a7e56adfcff85487', 'request_id': 'req-1db85951-ccb2-46bb-a42f-4f92e728d41b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.986092 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:36.991573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] The token cache is being invalidate because project 21383b5049b84777a7e56adfcff85487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:36.992085 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.993169 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1db85951-ccb2-46bb-a42f-4f92e728d41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:36.994911 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1437/2885] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:36 2022] DELETE /identity/v3/projects/21383b5049b84777a7e56adfcff85487 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:37.000285 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd0b9-e9ec-44e5-b037-1c507fd3dda4 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.000831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd0b9-e9ec-44e5-b037-1c507fd3dda4 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.000831 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd0b9-e9ec-44e5-b037-1c507fd3dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.021034 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-aecfd0b9-e9ec-44e5-b037-1c507fd3dda4 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:37.022276 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-aecfd0b9-e9ec-44e5-b037-1c507fd3dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:37.096275 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1449/2886] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:37.104062 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e621-5e3d-4862-bb63-c227323ccaf8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.104343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e621-5e3d-4862-bb63-c227323ccaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.104615 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e621-5e3d-4862-bb63-c227323ccaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.126311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0158e621-5e3d-4862-bb63-c227323ccaf8 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:37.127548 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0158e621-5e3d-4862-bb63-c227323ccaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:37.135669 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1438/2887] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:37.140725 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfd0b9-e9ec-44e5-b037-1c507fd3dda4 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.150634 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfd0b9-e9ec-44e5-b037-1c507fd3dda4 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.155344 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.155984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.156259 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.156527 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] PATH_INFO: `/v3/domains` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.157431 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81448) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:33:37.157758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.159342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.171553 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1450/2888] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 06 12:33:37.176304 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158e621-5e3d-4862-bb63-c227323ccaf8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.185742 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158e621-5e3d-4862-bb63-c227323ccaf8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.190995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2982f5-155d-4741-877d-56eda066be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.191603 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2982f5-155d-4741-877d-56eda066be93 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.191885 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2982f5-155d-4741-877d-56eda066be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.192159 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2982f5-155d-4741-877d-56eda066be93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.192790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2982f5-155d-4741-877d-56eda066be93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.194730 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2982f5-155d-4741-877d-56eda066be93 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.224309 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1439/2889] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:37 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:37.228594 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.246214 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5040-80e0-47dc-a7e6-40b8ad9ec038 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.306005 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42e433-e211-43c9-8688-5183744ae3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.306592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42e433-e211-43c9-8688-5183744ae3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.306873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42e433-e211-43c9-8688-5183744ae3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.307143 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42e433-e211-43c9-8688-5183744ae3dc admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.307793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42e433-e211-43c9-8688-5183744ae3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.309736 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42e433-e211-43c9-8688-5183744ae3dc admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.333012 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1451/2890] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:37 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:37.337354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2982f5-155d-4741-877d-56eda066be93 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.349356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2982f5-155d-4741-877d-56eda066be93 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.354605 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b2e52-5489-4b5d-a1cf-469bdf6ec762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.355302 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2e52-5489-4b5d-a1cf-469bdf6ec762 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.355618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2e52-5489-4b5d-a1cf-469bdf6ec762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.355945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2e52-5489-4b5d-a1cf-469bdf6ec762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.356697 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b2e52-5489-4b5d-a1cf-469bdf6ec762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.359122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b2e52-5489-4b5d-a1cf-469bdf6ec762 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.369834 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1440/2891] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:37.374145 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42e433-e211-43c9-8688-5183744ae3dc admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.385004 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42e433-e211-43c9-8688-5183744ae3dc admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.389886 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a3791-5e2f-47e2-b54e-a9779da23aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.390707 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a3791-5e2f-47e2-b54e-a9779da23aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.391159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a3791-5e2f-47e2-b54e-a9779da23aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.391432 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a3791-5e2f-47e2-b54e-a9779da23aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.392080 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a3791-5e2f-47e2-b54e-a9779da23aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.393699 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a3791-5e2f-47e2-b54e-a9779da23aa5 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.404664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1452/2892] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:37.409476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b2e52-5489-4b5d-a1cf-469bdf6ec762 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.419540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b2e52-5489-4b5d-a1cf-469bdf6ec762 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.424849 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9377ac1-268b-445c-a964-9661455e2b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.425507 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9377ac1-268b-445c-a964-9661455e2b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.425909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9377ac1-268b-445c-a964-9661455e2b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.426100 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9377ac1-268b-445c-a964-9661455e2b98 admin admin] PATH_INFO: `/v3/projects/2d2308828e55424e9fc2d33c14dc111a/users/b874244802034f5ea36f68bd995e8c86/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.444246 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9377ac1-268b-445c-a964-9661455e2b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2308828e55424e9fc2d33c14dc111a, user_id=b874244802034f5ea36f68bd995e8c86, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.447776 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9377ac1-268b-445c-a964-9661455e2b98 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.472820 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1441/2893] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:37 2022] PUT /identity/v3/projects/2d2308828e55424e9fc2d33c14dc111a/users/b874244802034f5ea36f68bd995e8c86/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:37.483185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e990a-77a2-4c23-9063-d6da980d924e None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.483471 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e990a-77a2-4c23-9063-d6da980d924e None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.484322 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e990a-77a2-4c23-9063-d6da980d924e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.516364 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-e23e990a-77a2-4c23-9063-d6da980d924e None None] MFA Rules not processed for user `b874244802034f5ea36f68bd995e8c86`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:37.517523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-e23e990a-77a2-4c23-9063-d6da980d924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:37.521922 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:37.599862 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1453/2894] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:37.600086 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9377ac1-268b-445c-a964-9661455e2b98 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.677992 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9377ac1-268b-445c-a964-9661455e2b98 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.683153 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a57082-3c27-4337-a8ba-975cb59ece77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.683837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57082-3c27-4337-a8ba-975cb59ece77 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.684186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57082-3c27-4337-a8ba-975cb59ece77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.684506 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57082-3c27-4337-a8ba-975cb59ece77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.685158 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a57082-3c27-4337-a8ba-975cb59ece77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.687207 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a57082-3c27-4337-a8ba-975cb59ece77 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.727801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1442/2895] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:37 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:37.729720 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e990a-77a2-4c23-9063-d6da980d924e None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.741753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e990a-77a2-4c23-9063-d6da980d924e None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.810117 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371ee66-015c-462e-baec-f19ebfba5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.810805 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ee66-015c-462e-baec-f19ebfba5130 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.811181 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ee66-015c-462e-baec-f19ebfba5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.811555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ee66-015c-462e-baec-f19ebfba5130 admin admin] PATH_INFO: `/v3/users` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.812544 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371ee66-015c-462e-baec-f19ebfba5130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.814955 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371ee66-015c-462e-baec-f19ebfba5130 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.849036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1454/2896] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:37 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:37.853025 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a57082-3c27-4337-a8ba-975cb59ece77 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.864856 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a57082-3c27-4337-a8ba-975cb59ece77 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.869861 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877c87a-183f-4d77-84c0-a43791673c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.870475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877c87a-183f-4d77-84c0-a43791673c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.870757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877c87a-183f-4d77-84c0-a43791673c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.871052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877c87a-183f-4d77-84c0-a43791673c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.871705 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877c87a-183f-4d77-84c0-a43791673c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.873324 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877c87a-183f-4d77-84c0-a43791673c71 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.885496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1443/2897] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:37.891756 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371ee66-015c-462e-baec-f19ebfba5130 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.902409 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371ee66-015c-462e-baec-f19ebfba5130 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:37.908284 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f100c4-b08f-438e-abf3-1c287d29db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:37.908963 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f100c4-b08f-438e-abf3-1c287d29db1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:37.909242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f100c4-b08f-438e-abf3-1c287d29db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:37.909596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f100c4-b08f-438e-abf3-1c287d29db1c admin admin] PATH_INFO: `/v3/projects/fb93bb1051ca44f6bbf3eef2d86e4934/users/3b8d337fd586484a843092f7d2dfce2b/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:37.927002 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f100c4-b08f-438e-abf3-1c287d29db1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb93bb1051ca44f6bbf3eef2d86e4934, user_id=3b8d337fd586484a843092f7d2dfce2b, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:37.929920 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f100c4-b08f-438e-abf3-1c287d29db1c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:37.945368 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1455/2898] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:37 2022] PUT /identity/v3/projects/fb93bb1051ca44f6bbf3eef2d86e4934/users/3b8d337fd586484a843092f7d2dfce2b/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:37.949748 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877c87a-183f-4d77-84c0-a43791673c71 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:37.959953 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877c87a-183f-4d77-84c0-a43791673c71 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:38.046530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a285e52-b4c0-4d0b-bcb4-bfa8379e1e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:38.047164 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a285e52-b4c0-4d0b-bcb4-bfa8379e1e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:38.047442 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a285e52-b4c0-4d0b-bcb4-bfa8379e1e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:38.047719 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a285e52-b4c0-4d0b-bcb4-bfa8379e1e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:38.048378 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a285e52-b4c0-4d0b-bcb4-bfa8379e1e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:38.050059 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a285e52-b4c0-4d0b-bcb4-bfa8379e1e63 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:38.064338 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1444/2899] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:38.065893 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f100c4-b08f-438e-abf3-1c287d29db1c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:38.076846 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f100c4-b08f-438e-abf3-1c287d29db1c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:38.084598 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:38.085293 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:38.085592 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:38.085873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] PATH_INFO: `/v3/projects/fb93bb1051ca44f6bbf3eef2d86e4934/users/3b8d337fd586484a843092f7d2dfce2b/roles/818fd3697c3b46ce81096e2fa76e90d4` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:38.087943 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb93bb1051ca44f6bbf3eef2d86e4934, user_id=3b8d337fd586484a843092f7d2dfce2b, role_id=818fd3697c3b46ce81096e2fa76e90d4)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:38.090697 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:38.106674 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1456/2900] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:38 2022] PUT /identity/v3/projects/fb93bb1051ca44f6bbf3eef2d86e4934/users/3b8d337fd586484a843092f7d2dfce2b/roles/818fd3697c3b46ce81096e2fa76e90d4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:38.117917 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12246c7-ada3-41d6-ac5d-4c7b00b796e7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:38.118210 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12246c7-ada3-41d6-ac5d-4c7b00b796e7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:38.118496 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12246c7-ada3-41d6-ac5d-4c7b00b796e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:38.130390 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:38.155662 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c12246c7-ada3-41d6-ac5d-4c7b00b796e7 None None] MFA Rules not processed for user `3b8d337fd586484a843092f7d2dfce2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:38.159437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c12246c7-ada3-41d6-ac5d-4c7b00b796e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:38.262896 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1445/2901] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:38.275910 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:38.277658 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:38.346559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123a45f-4bd1-4169-98b1-2d29e227de72 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:38.350185 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f97a-3826-4d72-beef-e66bb5e63165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:38.350798 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f97a-3826-4d72-beef-e66bb5e63165 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:38.351074 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f97a-3826-4d72-beef-e66bb5e63165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:38.351342 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f97a-3826-4d72-beef-e66bb5e63165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:38.361457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515f97a-3826-4d72-beef-e66bb5e63165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:38.362960 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515f97a-3826-4d72-beef-e66bb5e63165 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:38.368601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:38.374183 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1457/2902] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:33:38.729109 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12246c7-ada3-41d6-ac5d-4c7b00b796e7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:38.739017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12246c7-ada3-41d6-ac5d-4c7b00b796e7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:38.743698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b8d337fd586484a843092f7d2dfce2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb93bb1051ca44f6bbf3eef2d86e4934', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:38.744312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:38.744593 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:38.744867 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:38.745523 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:33:38.745858 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:38.747449 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:38.760588 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1446/2903] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:33:38.764952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f97a-3826-4d72-beef-e66bb5e63165 service cinder] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:38.775172 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f97a-3826-4d72-beef-e66bb5e63165 service cinder] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:38.779891 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb673-6d47-4989-b05a-87b1663be378 tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b8d337fd586484a843092f7d2dfce2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb93bb1051ca44f6bbf3eef2d86e4934', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:38.780502 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb673-6d47-4989-b05a-87b1663be378 tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:38.780784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb673-6d47-4989-b05a-87b1663be378 tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:38.781058 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb673-6d47-4989-b05a-87b1663be378 tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:38.782195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbb673-6d47-4989-b05a-87b1663be378 tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:38.784107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbb673-6d47-4989-b05a-87b1663be378 tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:38.816918 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1458/2904] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:38 2022] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:38.821074 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:38.831312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a561e-588b-4a83-87af-55d02ed2114f tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:38.893989 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b8d337fd586484a843092f7d2dfce2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb93bb1051ca44f6bbf3eef2d86e4934', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:38.894726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:38.894887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:38.895170 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:38.895840 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:33:38.896150 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:38.897792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:38.911636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1447/2905] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:33:38.952122 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb673-6d47-4989-b05a-87b1663be378 tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:38.962667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb673-6d47-4989-b05a-87b1663be378 tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:38.967325 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b8d337fd586484a843092f7d2dfce2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb93bb1051ca44f6bbf3eef2d86e4934', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:38.967956 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:38.968242 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:38.968513 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] PATH_INFO: `/v3/projects/00f7a32bbae9463eb30f34de4d21f3b0` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:38.969689 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Authorizing `identity:delete_project(project_id=00f7a32bbae9463eb30f34de4d21f3b0)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:38.971596 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:39.022661 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f7a32bbae9463eb30f34de4d21f3b0', 'request_id': 'req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.030156 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f7a32bbae9463eb30f34de4d21f3b0', 'request_id': 'req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.039050 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f7a32bbae9463eb30f34de4d21f3b0', 'request_id': 'req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.053210 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] The token cache is being invalidate because project 00f7a32bbae9463eb30f34de4d21f3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:39.053490 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.054263 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-0d24a7cc-8cbd-4b7d-96c2-a53f999e881e tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.055758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1459/2906] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:38 2022] DELETE /identity/v3/projects/00f7a32bbae9463eb30f34de4d21f3b0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:39.262354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:39.264052 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:39.340720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80937-a73c-43d2-b6f8-2cb8caf4885a tempest-VolumeQuotaClassesTest-2146218964 tempest-VolumeQuotaClassesTest-2146218964-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:39.355629 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:39.403562 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:39.404201 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:39.404488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:39.404764 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] PATH_INFO: `/v3/users/b874244802034f5ea36f68bd995e8c86` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:39.406487 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b874244802034f5ea36f68bd995e8c86)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:39.408690 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:39.465757 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b874244802034f5ea36f68bd995e8c86'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.466312 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b874244802034f5ea36f68bd995e8c86'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.475161 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b874244802034f5ea36f68bd995e8c86'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.489340 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b874244802034f5ea36f68bd995e8c86'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.496816 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b874244802034f5ea36f68bd995e8c86'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:39.511698 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1448/2907] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:39 2022] DELETE /identity/v3/users/b874244802034f5ea36f68bd995e8c86 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:39.518833 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19edf4-df7d-4af5-b65b-4c17b8b8b6f3 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:39.519395 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19edf4-df7d-4af5-b65b-4c17b8b8b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:39.519667 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19edf4-df7d-4af5-b65b-4c17b8b8b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:39.547142 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-ba19edf4-df7d-4af5-b65b-4c17b8b8b6f3 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:39.548273 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ba19edf4-df7d-4af5-b65b-4c17b8b8b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:39.626061 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1460/2908] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:39.635976 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:39.637429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:39.698118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634328-5b71-4ab0-a536-90a2093c4080 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:39.701918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ebddb-4607-42ba-b11b-1f50352d79cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:39.702528 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ebddb-4607-42ba-b11b-1f50352d79cd service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:39.703393 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ebddb-4607-42ba-b11b-1f50352d79cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:39.703666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ebddb-4607-42ba-b11b-1f50352d79cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:39.719143 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ebddb-4607-42ba-b11b-1f50352d79cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:39.720591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ebddb-4607-42ba-b11b-1f50352d79cd service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:39.731262 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1449/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:40.024952 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19edf4-df7d-4af5-b65b-4c17b8b8b6f3 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:40.026556 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-ba19edf4-df7d-4af5-b65b-4c17b8b8b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:40.043232 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19edf4-df7d-4af5-b65b-4c17b8b8b6f3 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:40.048872 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:40.050194 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:40.050358 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:40.050619 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] PATH_INFO: `/v3/projects/2d2308828e55424e9fc2d33c14dc111a` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:40.052672 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2308828e55424e9fc2d33c14dc111a)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:40.054657 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:40.104710 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2308828e55424e9fc2d33c14dc111a', 'request_id': 'req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.111560 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2308828e55424e9fc2d33c14dc111a', 'request_id': 'req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.113799 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:40.119346 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2308828e55424e9fc2d33c14dc111a', 'request_id': 'req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.135579 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] The token cache is being invalidate because project 2d2308828e55424e9fc2d33c14dc111a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:40.135913 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.136608 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.138224 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1461/2910] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:40 2022] DELETE /identity/v3/projects/2d2308828e55424e9fc2d33c14dc111a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:40.143221 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ebddb-4607-42ba-b11b-1f50352d79cd service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:40.153602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ebddb-4607-42ba-b11b-1f50352d79cd service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:40.193427 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:40.216828 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:40.217485 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:40.217795 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:40.218070 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] PATH_INFO: `/v3/users/3b8d337fd586484a843092f7d2dfce2b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:40.220135 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8d337fd586484a843092f7d2dfce2b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:40.222132 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:40.286510 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8d337fd586484a843092f7d2dfce2b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.287147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8d337fd586484a843092f7d2dfce2b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.304887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8d337fd586484a843092f7d2dfce2b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.318075 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8d337fd586484a843092f7d2dfce2b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.325723 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d2f815e-632f-40d8-a512-1af2d1980e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8d337fd586484a843092f7d2dfce2b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.332749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1450/2911] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:40 2022] DELETE /identity/v3/users/3b8d337fd586484a843092f7d2dfce2b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:40.632927 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:40.635465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:40.654084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e943-43c1-4b9f-ae63-98ca06fb1d3b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:40.736134 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:40.736804 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:40.737084 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:40.737352 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] PATH_INFO: `/v3/projects/fb93bb1051ca44f6bbf3eef2d86e4934` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:40.738615 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb93bb1051ca44f6bbf3eef2d86e4934)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:40.740841 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:40.789300 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb93bb1051ca44f6bbf3eef2d86e4934', 'request_id': 'req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.795564 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb93bb1051ca44f6bbf3eef2d86e4934', 'request_id': 'req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.801883 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb93bb1051ca44f6bbf3eef2d86e4934', 'request_id': 'req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.816256 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] The token cache is being invalidate because project fb93bb1051ca44f6bbf3eef2d86e4934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:40.816535 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.817193 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-8ab0ae35-542e-4309-9c49-fa1de3ccf75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:40.819360 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1462/2912] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:40 2022] DELETE /identity/v3/projects/fb93bb1051ca44f6bbf3eef2d86e4934 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:40.824129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ce4c-e068-4231-a294-55e148a26549 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:40.824424 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ce4c-e068-4231-a294-55e148a26549 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:40.824715 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ce4c-e068-4231-a294-55e148a26549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:40.846478 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7111ce4c-e068-4231-a294-55e148a26549 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:40.847724 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7111ce4c-e068-4231-a294-55e148a26549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:40.927355 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1451/2913] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:40.935356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932cd1f-f8cb-4299-99fb-79ce07ab67de None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:40.935639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932cd1f-f8cb-4299-99fb-79ce07ab67de None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:40.935909 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932cd1f-f8cb-4299-99fb-79ce07ab67de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:40.957419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-c932cd1f-f8cb-4299-99fb-79ce07ab67de None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:40.958868 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-c932cd1f-f8cb-4299-99fb-79ce07ab67de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:40.967825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1463/2914] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:40.972437 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111ce4c-e068-4231-a294-55e148a26549 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:40.982347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111ce4c-e068-4231-a294-55e148a26549 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:40.987611 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:40.988224 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:40.988512 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:40.988792 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:40.989454 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:33:40.989790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:40.991391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.004536 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1452/2915] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:33:41.008968 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932cd1f-f8cb-4299-99fb-79ce07ab67de None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:41.018647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932cd1f-f8cb-4299-99fb-79ce07ab67de None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:41.023343 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e22527-bcf6-4e1b-987a-b6a76fb87614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:41.023954 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e22527-bcf6-4e1b-987a-b6a76fb87614 admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.024234 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e22527-bcf6-4e1b-987a-b6a76fb87614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.024508 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e22527-bcf6-4e1b-987a-b6a76fb87614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.025160 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e22527-bcf6-4e1b-987a-b6a76fb87614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:41.027107 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e22527-bcf6-4e1b-987a-b6a76fb87614 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.058803 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1464/2916] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:41 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:33:41.063753 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:41.074296 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6409b40-0ccd-4107-b881-111ac8ae3014 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:41.122249 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:41.139423 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e0a20-8a58-42e8-85af-4621f3cbd84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:41.140039 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e0a20-8a58-42e8-85af-4621f3cbd84d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.140370 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e0a20-8a58-42e8-85af-4621f3cbd84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.140785 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e0a20-8a58-42e8-85af-4621f3cbd84d admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.141426 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e0a20-8a58-42e8-85af-4621f3cbd84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:41.143357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e0a20-8a58-42e8-85af-4621f3cbd84d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.165974 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1453/2917] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:41 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:33:41.170283 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e22527-bcf6-4e1b-987a-b6a76fb87614 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:41.182588 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e22527-bcf6-4e1b-987a-b6a76fb87614 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:41.188147 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b335c-539a-4b0b-bc97-2a83f6b2c75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:41.188784 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b335c-539a-4b0b-bc97-2a83f6b2c75b admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.189063 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b335c-539a-4b0b-bc97-2a83f6b2c75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.189337 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b335c-539a-4b0b-bc97-2a83f6b2c75b admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.190036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b335c-539a-4b0b-bc97-2a83f6b2c75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:41.191651 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b335c-539a-4b0b-bc97-2a83f6b2c75b admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.202706 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1465/2918] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:41.207508 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e0a20-8a58-42e8-85af-4621f3cbd84d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:41.218177 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e0a20-8a58-42e8-85af-4621f3cbd84d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:41.224073 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c0bfe-c832-43ce-8219-92a76acc8e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:41.224726 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c0bfe-c832-43ce-8219-92a76acc8e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.225009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c0bfe-c832-43ce-8219-92a76acc8e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.225283 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c0bfe-c832-43ce-8219-92a76acc8e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.225988 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c0bfe-c832-43ce-8219-92a76acc8e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:41.227591 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c0bfe-c832-43ce-8219-92a76acc8e46 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.243661 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1454/2919] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:41.248096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b335c-539a-4b0b-bc97-2a83f6b2c75b admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:41.261823 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b335c-539a-4b0b-bc97-2a83f6b2c75b admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:41.267363 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:41.268036 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.268642 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.269589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] PATH_INFO: `/v3/projects/c513031a07c641c09f98fe6cc084a41c/users/8f021d21efb6416589c6e9977c675ab2/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.286006 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c513031a07c641c09f98fe6cc084a41c, user_id=8f021d21efb6416589c6e9977c675ab2, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:41.288683 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.305518 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1466/2920] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:41 2022] PUT /identity/v3/projects/c513031a07c641c09f98fe6cc084a41c/users/8f021d21efb6416589c6e9977c675ab2/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:41.317280 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f32e-cd61-4a26-a3d2-aeb64d8e9607 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.317602 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f32e-cd61-4a26-a3d2-aeb64d8e9607 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.317978 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f32e-cd61-4a26-a3d2-aeb64d8e9607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.347971 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-78c5f32e-cd61-4a26-a3d2-aeb64d8e9607 None None] MFA Rules not processed for user `8f021d21efb6416589c6e9977c675ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:41.349200 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-78c5f32e-cd61-4a26-a3d2-aeb64d8e9607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:41.414476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1455/2921] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:41.426782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:41.428990 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:41.445348 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:41.495195 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d48c8-c509-407f-b1a7-54c5d44b6ce7 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:41.499053 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc608b6-0d09-4170-8386-c88445599aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:41.500000 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc608b6-0d09-4170-8386-c88445599aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.500475 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc608b6-0d09-4170-8386-c88445599aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.500825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc608b6-0d09-4170-8386-c88445599aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.510144 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc608b6-0d09-4170-8386-c88445599aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:41.511631 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc608b6-0d09-4170-8386-c88445599aa6 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.522083 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1467/2922] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:41.542990 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5f32e-cd61-4a26-a3d2-aeb64d8e9607 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:41.616782 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5f32e-cd61-4a26-a3d2-aeb64d8e9607 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:41.621396 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:41.622063 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.622347 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.622624 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] PATH_INFO: `/v3/users/8f021d21efb6416589c6e9977c675ab2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.623784 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f021d21efb6416589c6e9977c675ab2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:41.626009 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.676793 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f021d21efb6416589c6e9977c675ab2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:41.677400 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f021d21efb6416589c6e9977c675ab2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:41.688430 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f021d21efb6416589c6e9977c675ab2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:41.691152 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:41.705790 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f021d21efb6416589c6e9977c675ab2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:41.712922 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f021d21efb6416589c6e9977c675ab2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:41.719686 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1456/2923] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:41 2022] DELETE /identity/v3/users/8f021d21efb6416589c6e9977c675ab2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:41.724184 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4daac9-b628-4dec-8c30-59a648471bbf None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.724698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4daac9-b628-4dec-8c30-59a648471bbf None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.724698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4daac9-b628-4dec-8c30-59a648471bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.744782 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-bd4daac9-b628-4dec-8c30-59a648471bbf None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:41.746197 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bd4daac9-b628-4dec-8c30-59a648471bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:41.808656 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1468/2924] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:41.819118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:41.820932 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:41.883540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df0f2c-01c6-423c-85ac-7c590b9275a6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:41.887311 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf70a1c-e87c-4ec6-9d68-133e609df013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:41.887925 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70a1c-e87c-4ec6-9d68-133e609df013 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:41.888211 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70a1c-e87c-4ec6-9d68-133e609df013 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:41.888488 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70a1c-e87c-4ec6-9d68-133e609df013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:41.899121 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf70a1c-e87c-4ec6-9d68-133e609df013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:41.900557 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf70a1c-e87c-4ec6-9d68-133e609df013 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:41.910594 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1457/2925] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:42.200258 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4daac9-b628-4dec-8c30-59a648471bbf None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:42.201778 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bd4daac9-b628-4dec-8c30-59a648471bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:42.216220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4daac9-b628-4dec-8c30-59a648471bbf None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:42.221279 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:42.222086 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.222538 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.222763 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] PATH_INFO: `/v3/projects/c513031a07c641c09f98fe6cc084a41c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.223959 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c513031a07c641c09f98fe6cc084a41c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:42.226753 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:42.279485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c513031a07c641c09f98fe6cc084a41c', 'request_id': 'req-574bca5e-890b-4eff-a39f-0ed55aa68f56'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:42.289163 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c513031a07c641c09f98fe6cc084a41c', 'request_id': 'req-574bca5e-890b-4eff-a39f-0ed55aa68f56'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:42.296115 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c513031a07c641c09f98fe6cc084a41c', 'request_id': 'req-574bca5e-890b-4eff-a39f-0ed55aa68f56'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:42.315014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] The token cache is being invalidate because project c513031a07c641c09f98fe6cc084a41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:42.315304 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:42.315995 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-574bca5e-890b-4eff-a39f-0ed55aa68f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:42.317485 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1469/2926] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:42 2022] DELETE /identity/v3/projects/c513031a07c641c09f98fe6cc084a41c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:42.322413 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77d98-bc93-48e3-9053-9d80131da84c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.322879 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77d98-bc93-48e3-9053-9d80131da84c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.322977 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77d98-bc93-48e3-9053-9d80131da84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.342809 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-25c77d98-bc93-48e3-9053-9d80131da84c None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:42.344015 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25c77d98-bc93-48e3-9053-9d80131da84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:42.415247 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1458/2927] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:42.424356 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869561c4-8aac-4719-a3f2-6a55a68fd9b2 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.424647 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869561c4-8aac-4719-a3f2-6a55a68fd9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.424926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869561c4-8aac-4719-a3f2-6a55a68fd9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.446541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-869561c4-8aac-4719-a3f2-6a55a68fd9b2 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:42.447772 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-869561c4-8aac-4719-a3f2-6a55a68fd9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:42.456248 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1470/2928] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:42.460646 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c77d98-bc93-48e3-9053-9d80131da84c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:42.470877 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c77d98-bc93-48e3-9053-9d80131da84c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:42.475745 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:42.476357 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.476641 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.476920 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.477606 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 06 12:33:42.477918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:42.479530 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:42.493004 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1459/2929] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Oct 6 12:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 06 12:33:42.497167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869561c4-8aac-4719-a3f2-6a55a68fd9b2 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:42.507139 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869561c4-8aac-4719-a3f2-6a55a68fd9b2 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:42.511948 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e981d8-db8b-499c-9e7e-27b774cce6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:42.512547 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e981d8-db8b-499c-9e7e-27b774cce6fb admin admin] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.512825 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e981d8-db8b-499c-9e7e-27b774cce6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.513096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e981d8-db8b-499c-9e7e-27b774cce6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.513771 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e981d8-db8b-499c-9e7e-27b774cce6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:42.516534 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e981d8-db8b-499c-9e7e-27b774cce6fb admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:42.548010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1471/2930] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Oct 6 12:33:42 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 06 12:33:42.553102 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:42.565050 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de339ceb-cafa-4fe5-a0a6-19a565552c5b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:42.626494 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236dae9-a66d-47a3-a846-4474a6a0d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:42.627118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236dae9-a66d-47a3-a846-4474a6a0d98e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.627407 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236dae9-a66d-47a3-a846-4474a6a0d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.627714 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236dae9-a66d-47a3-a846-4474a6a0d98e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.628391 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236dae9-a66d-47a3-a846-4474a6a0d98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:42.630343 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236dae9-a66d-47a3-a846-4474a6a0d98e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:42.641295 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:42.661214 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1460/2931] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Oct 6 12:33:42 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 06 12:33:42.662555 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e981d8-db8b-499c-9e7e-27b774cce6fb admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:42.674678 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e981d8-db8b-499c-9e7e-27b774cce6fb admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:42.680465 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812f1a4-4436-4b8e-9fc2-2da7d845dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:42.681324 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f1a4-4436-4b8e-9fc2-2da7d845dfce admin admin] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.681638 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f1a4-4436-4b8e-9fc2-2da7d845dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.681924 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f1a4-4436-4b8e-9fc2-2da7d845dfce admin admin] PATH_INFO: `/v3/roles` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.682673 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812f1a4-4436-4b8e-9fc2-2da7d845dfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:42.684890 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812f1a4-4436-4b8e-9fc2-2da7d845dfce admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:42.690220 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:42.700301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1472/2932] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 06 12:33:42.703965 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236dae9-a66d-47a3-a846-4474a6a0d98e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:42.713918 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236dae9-a66d-47a3-a846-4474a6a0d98e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:42.719167 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c76d4c-c9e7-4ab9-8b0f-0b9cf3d4968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:42.720097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76d4c-c9e7-4ab9-8b0f-0b9cf3d4968b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.720097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76d4c-c9e7-4ab9-8b0f-0b9cf3d4968b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.720540 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76d4c-c9e7-4ab9-8b0f-0b9cf3d4968b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.721149 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c76d4c-c9e7-4ab9-8b0f-0b9cf3d4968b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:42.722681 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c76d4c-c9e7-4ab9-8b0f-0b9cf3d4968b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:42.735626 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1461/2933] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Oct 6 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 06 12:33:42.741593 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812f1a4-4436-4b8e-9fc2-2da7d845dfce admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:42.761640 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812f1a4-4436-4b8e-9fc2-2da7d845dfce admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:42.770669 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:42.771599 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] REQUEST_METHOD: `PUT` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.771972 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.772313 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] PATH_INFO: `/v3/projects/23871592fab445dcb290aa1c9b918a8c/users/5ec815fae94e4697b5b74887121fd45f/roles/d33de683560f4a1d95bcd204be71dc4f` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.792716 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23871592fab445dcb290aa1c9b918a8c, user_id=5ec815fae94e4697b5b74887121fd45f, role_id=d33de683560f4a1d95bcd204be71dc4f)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:42.796486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:42.814296 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1473/2934] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Oct 6 12:33:42 2022] PUT /identity/v3/projects/23871592fab445dcb290aa1c9b918a8c/users/5ec815fae94e4697b5b74887121fd45f/roles/d33de683560f4a1d95bcd204be71dc4f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:42.824763 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16015fc-998d-4d3d-a785-67f3dda929c3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:42.825047 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16015fc-998d-4d3d-a785-67f3dda929c3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:42.825325 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16015fc-998d-4d3d-a785-67f3dda929c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:42.858475 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b16015fc-998d-4d3d-a785-67f3dda929c3 None None] MFA Rules not processed for user `5ec815fae94e4697b5b74887121fd45f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:42.860447 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b16015fc-998d-4d3d-a785-67f3dda929c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:42.930453 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1462/2935] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:42.944391 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:42.946317 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:43.015029 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5b922-c80e-4d3a-9945-27509fb0b29c admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:43.019536 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea8a2b-c216-4e7d-a7bc-6bb569487c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f401923fe84446b9962e854f1fc2bed3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:43.020150 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8a2b-c216-4e7d-a7bc-6bb569487c15 service cinder] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:43.020454 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8a2b-c216-4e7d-a7bc-6bb569487c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:43.020729 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8a2b-c216-4e7d-a7bc-6bb569487c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:43.029617 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea8a2b-c216-4e7d-a7bc-6bb569487c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:43.031076 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea8a2b-c216-4e7d-a7bc-6bb569487c15 service cinder] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:43.041417 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1474/2936] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:33:45.648644 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16015fc-998d-4d3d-a785-67f3dda929c3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:45.715222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16015fc-998d-4d3d-a785-67f3dda929c3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:45.720450 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:45.721077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:45.721356 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:45.721660 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] PATH_INFO: `/v3/users/5ec815fae94e4697b5b74887121fd45f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:45.722789 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec815fae94e4697b5b74887121fd45f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:45.724706 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:45.779995 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec815fae94e4697b5b74887121fd45f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:45.780653 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec815fae94e4697b5b74887121fd45f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:45.789924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec815fae94e4697b5b74887121fd45f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:45.804582 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec815fae94e4697b5b74887121fd45f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:45.806777 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:45.820282 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec815fae94e4697b5b74887121fd45f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:45.826574 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1463/2937] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:33:45 2022] DELETE /identity/v3/users/5ec815fae94e4697b5b74887121fd45f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:45.831486 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe29-4e34-47b7-a465-2d11d0668e04 None None] REQUEST_METHOD: `POST` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:45.831992 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe29-4e34-47b7-a465-2d11d0668e04 None None] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:45.832095 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe29-4e34-47b7-a465-2d11d0668e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:45.853079 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.auth.core [None req-6d3dfe29-4e34-47b7-a465-2d11d0668e04 None None] MFA Rules not processed for user `76a491a3cc6546888fbf514517cd658a`. Rule list: `[]` (Enabled: `True`). {{(pid=81448) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 06 12:33:45.854523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6d3dfe29-4e34-47b7-a465-2d11d0668e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:45.917113 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1475/2938] 10.222.0.15 () {58 vars in 958 bytes} [Thu Oct 6 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 06 12:33:45.928472 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:45.929945 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:45.994373 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c7052-3dcd-4599-807b-666d02c34a76 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:45.998065 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ce6e7-5c05-4dd9-8fff-43da85a948f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:45.998666 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ce6e7-5c05-4dd9-8fff-43da85a948f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:45.998948 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ce6e7-5c05-4dd9-8fff-43da85a948f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:45.999222 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ce6e7-5c05-4dd9-8fff-43da85a948f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:46.008643 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ce6e7-5c05-4dd9-8fff-43da85a948f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:46.010097 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ce6e7-5c05-4dd9-8fff-43da85a948f5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:46.021618 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1464/2939] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:33:46.316510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfe29-4e34-47b7-a465-2d11d0668e04 None None] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:33:46.318698 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-6d3dfe29-4e34-47b7-a465-2d11d0668e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:33:46.339523 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfe29-4e34-47b7-a465-2d11d0668e04 None None] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:33:46.345519 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:33:46.346221 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:33:46.346581 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:33:46.346758 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] PATH_INFO: `/v3/projects/23871592fab445dcb290aa1c9b918a8c` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:33:46.347940 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23871592fab445dcb290aa1c9b918a8c)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:33:46.349939 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:33:46.406853 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23871592fab445dcb290aa1c9b918a8c', 'request_id': 'req-b2aadfea-835d-475f-b04d-ef9d1266eea6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:46.413601 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23871592fab445dcb290aa1c9b918a8c', 'request_id': 'req-b2aadfea-835d-475f-b04d-ef9d1266eea6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:46.419507 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23871592fab445dcb290aa1c9b918a8c', 'request_id': 'req-b2aadfea-835d-475f-b04d-ef9d1266eea6'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:46.429166 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:33:46.433570 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] The token cache is being invalidate because project 23871592fab445dcb290aa1c9b918a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81448) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:33:46.433873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:46.434788 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:33:46.436449 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1476/2940] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:33:46 2022] DELETE /identity/v3/projects/23871592fab445dcb290aa1c9b918a8c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:33:56.015572 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=30 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:35:57.267638 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ce6e7-5c05-4dd9-8fff-43da85a948f5 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:35:57.277354 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ce6e7-5c05-4dd9-8fff-43da85a948f5 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:35:57.329731 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:35:57.330412 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:35:57.330893 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:35:57.331383 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:35:57.334051 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:57.347183 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:35:57.349635 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:35:57.360553 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1465/2941] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:35:57.442817 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:35:57.444328 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:57.457014 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aadfea-835d-475f-b04d-ef9d1266eea6 admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:35:57.460622 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:35:57.461260 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:35:57.461582 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:35:57.461851 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:35:57.463740 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:57.539531 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:35:57.540882 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:35:57.554319 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1477/2942] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:35:57.618081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:35:57.619464 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:57.689077 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902cc2c-afee-429f-b643-381d07ac34cc service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:35:57.701403 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:35:57.702071 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:35:57.702360 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:35:57.702637 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:35:57.706773 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:57.726151 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:35:57.727761 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:35:57.738665 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1466/2943] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:35:58.550031 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:35:58.552043 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:58.567732 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78246318-1a65-4bfb-83d2-9761cef32c38 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:35:58.572984 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:35:58.573639 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:35:58.573926 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:35:58.574227 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:35:58.576633 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:58.588957 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:35:58.590664 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:35:58.602030 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1478/2944] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:35:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:35:59.486388 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:35:59.487801 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:59.510117 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f245e-5339-44ea-9ec7-3e7c4bedaf11 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:35:59.516909 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:35:59.517556 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:35:59.517846 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:35:59.518122 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:35:59.520558 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:35:59.533946 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:35:59.535587 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:35:59.548477 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1467/2945] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:35:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:36:08.596839 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=40 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:36:09.542118 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=64 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:37:33.977419 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:37:33.993054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21103674-17c0-456c-970b-227a7ffefc84 service placement] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:37:33.999541 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:37:34.000159 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:37:34.000437 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:37:34.000708 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:37:34.002501 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:37:34.016446 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:37:34.018068 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:37:34.031510 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1479/2946] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:37:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:37:36.484815 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:37:36.498239 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8db53-4a1b-4ff7-9599-368684835da5 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:37:36.503924 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd257708357455d99990b01af81e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:37:36.505060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:37:36.505060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:37:36.505060 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:37:36.507181 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:37:36.520780 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:37:36.522392 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:37:36.534104 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1468/2947] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:37:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 06 12:37:37.846565 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:37:37.848315 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:37:37.861199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e31e2-73d1-4cf8-b504-f040530ca239 service nova] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:37:37.864921 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8bc6ac1df7f4bd383fded2b9a22ecf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:37:37.865462 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:37:37.865796 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:37:37.866070 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:37:37.867779 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:37:37.933994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:37:37.935453 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:37:37.945504 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1480/2948] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:37:40.772481 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:37:40.789362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f50b-f127-40e6-af5a-a6676b42b4d7 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:37:40.795422 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:37:40.796326 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:37:40.796609 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:37:40.797459 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:37:40.799389 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:37:40.812476 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:37:40.814281 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:37:40.831160 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1469/2949] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:37:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:37:44.036333 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:37:44.037958 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:37:44.054802 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeca97-60e1-4096-b632-ebaf63ba4407 service neutron] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:37:44.059427 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:37:44.060054 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:37:44.060335 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:37:44.060609 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] PATH_INFO: `/v3/users/1672a7bfdff14b68b214015619989424` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:37:44.061752 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1672a7bfdff14b68b214015619989424)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:37:44.063662 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:37:44.111731 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1672a7bfdff14b68b214015619989424'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.112403 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1672a7bfdff14b68b214015619989424'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.113010 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1672a7bfdff14b68b214015619989424'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.125131 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1672a7bfdff14b68b214015619989424'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.132975 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1672a7bfdff14b68b214015619989424'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.145793 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1481/2950] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:37:44 2022] DELETE /identity/v3/users/1672a7bfdff14b68b214015619989424 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:37:44.328716 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:37:44.341279 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361adb-04e4-4691-bbc9-d12eef440500 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:37:44.407017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:37:44.407568 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:37:44.407854 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:37:44.408130 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] PATH_INFO: `/v3/projects/4ac127a2185140388115163cdb0b3e75` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:37:44.409429 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac127a2185140388115163cdb0b3e75)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:37:44.411539 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:37:44.462720 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac127a2185140388115163cdb0b3e75', 'request_id': 'req-107bb083-8bf5-4e27-9e92-b44da65aab67'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.469831 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac127a2185140388115163cdb0b3e75', 'request_id': 'req-107bb083-8bf5-4e27-9e92-b44da65aab67'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.475625 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac127a2185140388115163cdb0b3e75', 'request_id': 'req-107bb083-8bf5-4e27-9e92-b44da65aab67'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.486837 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] The token cache is being invalidate because project 4ac127a2185140388115163cdb0b3e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:37:44.487133 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.488017 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.489822 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1470/2951] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:37:44 2022] DELETE /identity/v3/projects/4ac127a2185140388115163cdb0b3e75 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:37:44.493971 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:37:44.495394 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:37:44.509855 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ee24-f421-4010-8061-71ac29e4b20f admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:37:44.569457 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:37:44.581216 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:37:44.581982 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:37:44.582312 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:37:44.582873 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] PATH_INFO: `/v3/users/31e0bdf2af504a10bf7f4beaff64bfef` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:37:44.584199 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e0bdf2af504a10bf7f4beaff64bfef)` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:37:44.586808 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:37:44.637290 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e0bdf2af504a10bf7f4beaff64bfef'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.637980 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e0bdf2af504a10bf7f4beaff64bfef'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.638585 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e0bdf2af504a10bf7f4beaff64bfef'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.650516 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e0bdf2af504a10bf7f4beaff64bfef'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.658314 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.notifications [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e0bdf2af504a10bf7f4beaff64bfef'} {{(pid=81448) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.670994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1482/2952] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Oct 6 12:37:44 2022] DELETE /identity/v3/users/31e0bdf2af504a10bf7f4beaff64bfef => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 06 12:37:44.842460 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:37:44.844129 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:37:44.860171 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bb083-8bf5-4e27-9e92-b44da65aab67 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:37:44.917501 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76a491a3cc6546888fbf514517cd658a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d4ef6c76dd94ad5804c0357e8bec7fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:37:44.918081 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:37:44.918362 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:37:44.918636 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] PATH_INFO: `/v3/projects/83d2386cc78e4daeba8c982123217c20` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:37:44.919740 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d2386cc78e4daeba8c982123217c20)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:37:44.921695 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:37:44.928559 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:37:44.971573 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d2386cc78e4daeba8c982123217c20', 'request_id': 'req-e58d4505-d9a6-48c2-8258-47bb33f709e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.979585 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d2386cc78e4daeba8c982123217c20', 'request_id': 'req-e58d4505-d9a6-48c2-8258-47bb33f709e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.985147 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d2386cc78e4daeba8c982123217c20', 'request_id': 'req-e58d4505-d9a6-48c2-8258-47bb33f709e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.996887 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] The token cache is being invalidate because project 83d2386cc78e4daeba8c982123217c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 06 12:37:44.997186 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.997931 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e58d4505-d9a6-48c2-8258-47bb33f709e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 06 12:37:44.999456 dv-cinder-856041-2-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1471/2953] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Oct 6 12:37:44 2022] DELETE /identity/v3/projects/83d2386cc78e4daeba8c982123217c20 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 06 12:37:54.667559 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:37:54.993749 dv-cinder-856041-2-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 12:41:52.756200 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] Authenticating user token {{(pid=81448) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 06 12:41:52.757618 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:41:52.895694 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fddf17-797e-4e27-bdc1-9259e06a01cf admin admin] Validating token access rules against request {{(pid=81448) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 06 12:41:52.957944 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d5390-9743-44bb-aca8-58d69b586065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3188514d47747c0ae22b9b35cf3c274', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c8d742de3a4bacaa90d9b54a952608', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81448) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 06 12:41:52.958586 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5390-9743-44bb-aca8-58d69b586065 service placement] REQUEST_METHOD: `GET` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 06 12:41:52.958894 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5390-9743-44bb-aca8-58d69b586065 service placement] SCRIPT_NAME: `/identity` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 06 12:41:52.959167 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5390-9743-44bb-aca8-58d69b586065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81448) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 06 12:41:52.960994 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.fernet_utils [None req-4d1d5390-9743-44bb-aca8-58d69b586065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81448) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 06 12:41:52.977301 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d5390-9743-44bb-aca8-58d69b586065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 06 12:41:52.979263 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d5390-9743-44bb-aca8-58d69b586065 service placement] RBAC: Authorization granted {{(pid=81448) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 06 12:41:52.994589 dv-cinder-856041-2-smb devstack@keystone.service[81448]: [pid: 81448|app: 0|req: 1483/2954] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Oct 6 12:41:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 06 12:42:02.988096 dv-cinder-856041-2-smb devstack@keystone.service[81448]: DEBUG dbcounter [-] [81448] Writing DB stats keystone:SELECT=89 {{(pid=81448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}